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ABSTRACT 


This thesis examines the performance of SRI’s Ambient Communications 
(AMBCOM) model for high-latitude propagation prediction. It is one in a series of 
studies, conducted at the Naval Postgraduate School, to establish the relative merits of 
several computer-based propagation prediction models using a standard set of measured 
data. 

AMBCOM modeled the propagation path between a transmitter located in the polar 
cap region and several midlatitude receiver sites. Model predictions were matched to 
measured data obtained during two high-latitude communication experiments (cam- 
paigns). The absolute difference between model signal-to-noise ratio (SNR) and meas- 
ured SNR was considered as error. Error statistics were accumulated to show the 
distribution of the error by campaign and frequency. The percentage, by frequency, of 
matched AMBCOM predictions in reference to total predictions for a given frequency 
was considered a measure of AMBCOM performance. 

AMBCOM exhibited small absolute values of average error, i.e., 7-11 dB, and high 
percentages of matched records. The average error was typicallv distributed between -20 
and +20 dB. Unfortunately, these are only relative measures of model performance. 
The site antenna and environmental data used to model high latitude campaigns were 
estimated not measured, and some variation in AMBCOM results may be attributable 
to poor estimates. The measured data were not designed specifically for model vali- 


dation, and further comparisons are needed with new measured data. 
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I. INTRODUCTION 


A. GENERAL 

During the summer of 1986 URSI sponsored a Workshop on the Practical Aspects 
of Ionospheric Modeling. The conference was attended by thirty-three scientists from 
five countries. The goal of the conference was to bring together ionospheric scientists 
and practioners to discuss ionospheric modeling. One of the recommendations which 
resulted from this conference was the following: 

There is a need to have a standardized set of data that can be used to verify 
ionospheric models. These data should be independent of the models that are being 
verified. The data need to he representative of the entire range of season, solar, and 
geomagnetic activity variations that 1s observed in practice. [Ref 1: p. 7-13] 

The purpose of this thesis is to examine the accuracy of propagation predictions 
from the Ambient Communications (AMP‘-“°\M) Computer-based model. This is done 
by comparing the signal-to-noise ratio (S°...) data generated by AMBCOM with the 
SNR data recorded during Project NONCENTRIC. The Project NONCENTRIC data 
are the signal and noise strengths of transmissions which were broadcast from one site 
Via an omni-directional antenna to several receiver sites during three high latitude com- 
munication experiments (campaigns) [Ref 2]. 

This thesis is divided into five chapters. The first chapter is a brief overview of the 
morphology of the high latitude ionosphere as it applies to AMBCOM. Chapter one 
also describes previous computer-based model evaluation work. The second chapter will 
describe the AMBCOM algorithms. Chapter three will characterize the Project 
NONCENTRIC data and describe how the data were assembled. The fourth chapter 
will compare the AMBCOM data with the Project NONCENTRIC data. The thesis 


then concludes with recommendations in chapter five. 


B. THE POLAR IONOSPHERE 
1. The Earth’s Magnetic Field 
The earth’s magnetic field may be approximated by an earth-centered dipole 
field which is tilted slightly out of the axis of the earth’s rotation. At the present time 
the northern pole of the dipole is located approximately at 78.8° N, 70.9°W using the 
geographic coordinate system [Ref: 3: p. 83]. As illustrated in Figure | on page 2 the 
earth's magnetic field is distorted from the expected dipole shape by the effect of the 











solar wind. Traveling at speeds near the carth of 200 to 700 kim/s, the solar wind bends 
the earth’s magnetic field into a teardrop shape with the tail of the ficld located opposite 
of the carth’s sunward side (Ref. 1: pp. 2-14;2-21]. The tail of the field can extend out- 


ward several earth radii depending upon the force of the solar wind [Ref f: p. 2-17]. 
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Figure 1. The earth’s magnetic field showing the effects of the solar wind. {From 
Ref. 6: p. 2-25] 


AMBCOM uses the three-hour K, index of worldwide magnetic disturbance to 
specify the current state of the carth’s magnetic field. This index is based upon local K 
indices which are semi-logarithmic values prepared at twelve selected obser‘ atories lo- 
cated between 48° and 63° geomagnetic latitude, north and south. The local K indices 
are values assigned by a local observatory to describe the condition of the planetary 
magnetic ficld at the measuring site. These local K values are then corrected and used 
to calculate the planetary K, index. [Ref. 4: pp. 49-51] 

The &, index is calculated at three hour intervals for a total of eight periods per 
day. The K, index ranges in value from zero, the least disturbed state, to nine which 
represents the most disturbed magnetic ficld. Typically the K, indices are calculated 
monthly and published in tabular form. The K, indices used for this thesis were pre- 


pared by the Geophysikalisches Institut, University of Gotungen and tabulated in the 








Journal of Geophysical Research [Ref. 5]. These K, indices were as low as zero and as 
high as seven which means that the geomagnetic field varied from a nondisturbed to a 
considerably disturbed state. 

When studying or modeling the ionosphere, the geomagnetic coordinate system 
is commonly used to map the ionosphere to an earth-bound coordinate system. This is 
understandable in hght of the fact that the earth’s magnetic field plavs a prominent part 
in the formation and variability of the ionosphere. The geomagnetic coordinate system 
is based upon the geographic location of the earth’s magnetic poles. The geomagnetic 
equator is displaced 90° from the geomagnetic poles. The longitudinal origin for this 
geomagnetic system is the meridian line which passes through the north and south 
geomagnetic poles and through the geographic south pole [Ref. 3: p. 84]. Davies [Ref. 
4: p. 40] relates the two systems with the equations 


sin ® = sin @ sin dy + cos g cos do cos(/ — Ay) (1) 
and 
: { cos @ sin(é — /9)) 
sin A= cos @ , (2) 
where 


go, = geographical latitude for the northern geomagnetic pole, 
A, = geographical longitude for the northern geomagnetic pole, 
g = geographical latitude, 

4 = geographical longitude, 

@ = geomagnetic latitude and 


A = geomagnetic longitude. 


Although AMBCOM makes the geographic-to-geomagnetic coordinate conversion for 
the user, an understanding of the geomagnetic coordinate system is useful with regard 
to understanding the AMBCOM model. 
2. Particle '’recipitation 

As the solar wind passes the earth, electrons, protons and other particles are 
captured by the earth's magnetic field. A captured particle does not fall directly to the 
errth but follows a spiral path along the magnetic field lines with velocity components 
parallel and perpendicular to the magnetic field. As a particle moves to higher latitudes 


the magnitudes of the components of its velocity vector change, but the total particle 





energy remains constant. This is due to the bending of the magnetic field lines relative 
to a particle’s velocity as the earth’s magnetic field returns to the ground at the magneuc 
poles. Increasingly the particle’s velocity becomes perpendicular to the magnetic field. 
The forward motion of the particle towards the pole stops and then reverses. The par- 
ticle then begins follow a spiral path towards the opposite geomagnetic pole, and, again, 
the components of the particle’s velocity vector change as the magnetic field lines bend 
earthward. Forward motion again stops and reverses. This point of reflection is called 
the mirror point. 

Depending upon the location of the mirror point. the particle can be trapped in 
the earth’s magnetic field indefinitely. If the particle’s mirror point, which is dependent 
upon its pitch angle when it entered the earth’s geomagnetic field, is above the atmos- 
phere then the particle will continue to reflect between the north and south mirror 
points. If the mirror point is within the atmosphere then the particle may collide with 
other particles in the upper atmosphere, lose energy and precipitate into the polar 
1onosphere. This particle precipitation leads to increased radio signal absorption, 1.e. 
auroral absorption and polar cap absorption (PCA), as well as visual displays of aurora 
borealis. Energetic electrons are the major cause of auroral absorption and the visible 
aurora. These particles have an energy level of about 10-100 KeV. PCA is attributed 
to the heavier but more energetic 10 MeV protons. [Ref. 6: pp. 2-18;2-20] 

3. The Auroral Oval 

The auroral oval, see Figure 2 on page 6, is the region where the visible aurora 
is most often observed (between 64° and 70° north geomagnetic latitude) [Ref. 4: p. 51]. 
The visible aurora is the result of the precipitation into the upper atmosphere of 
electrons which have been carried to the polar regions by the earth’s magnetic field. 
Since the amount of precipitation depends upon the number of particles available, any 
occurrence which increases the number of particles captured by the earth’s magnetic field 
will increase particle precipitation in the auroral zone. During a solar event, such as a 
solar flare, large numbers of high energy particles are ejected from the sun. These par- 
ticles speed towards the earth and cause a disturbance in the earth’s geomagnetic field 
which leads to particle precipitation in the polar regions. Jones [Ref. 2] makes the 
metaphorical comparison of particles traveling along the magnetic field lines as being in 
tubes something like a tube of toothpaste. When a disturbance occurs in the earth's 
magnetic field the particles (which are moving between the mirror points) are “squeezed 
out” into the high latitude upper atmosphere. This results in higher propagating fre- 


quencies and auroral absorption. 


The size and location of the auroral oval at any given time is variable because 
of its dependence upon particle precipitation which varies with solar activity . The oval 
is usually thicker and extends equatorward on its midnight side and migrates poleward 
on the noon side [{Ref. 7: p. 348]. The midnight side of the oval is where substorm ac- 
uvity begins before it follows the electrical potential gradient toward the oval’s noon side 
{Ref. 8: pp. 431-437]. In addition to the visible aurora these particles also produce 
ionization which results in auroral absorption, sporadic E, and other high latitude phe- 
nomena which do not always coincide with the location of the auroral oval [Ref. 4: pp. 
332-336}. 

Equatorward of the auroral oval is a region of low ionization density called the 
midlatitude trough. The midlatitude trough is caused by ionospheric currents resulting 
from the large electrical potential difference between the day and night side of the polar 
region. Hargreaves [Ref. 1: p.7-7] describes the trough as a nighttime occurrence be- 
tween 60° and 65° geomagnetic latitude during all seasons. During the summer months 
the midlatitude trough occurs closer to midnight. At night and during magnetic storms 
the trough moves equatorward. The midlatitude trough is of interest to the commu- 
nicator because it effects propagation paths. Critical frequencies within the trough can 
be as low as 1 MHz. Higher frequency transmissions along paths with reflection points 
in the midlatitude trough are not reflected downward and pass into space. 

4. High Latitude Propagation Anomalies 

The higher latitude ionosphere is not as dependent upon direct solar x-ray and 
ultraviolet radiation for the creation of ionization layers such as the D, E, sporadic LE 
or F lavers. The lavering of the polar ionosphere is produced by a combination of solar 
radiation and particle precipitation. The contribution of particle precipitation is ob- 
servable as increased ionization density in the E layer and a reduction in F, ionization 
density during periods when the solar zenith angle (y) is greater than 90° [Ref. 9: p. 28]. 
As can be seen in Figure 3 on page 7, auroral absorption exhibits two maximums, one 
at midnight and one at noon. Hargreaves [Ref. 10: p. 1358] states that there is a definite 
correlation between the amount of magnetospheric disturbance and increased aurcral 
absorption. An increase in the K, index would presage an increase in auroral absorption 
due to particle precipitation into the auroral oval. Hargreaves [Ref. 10: p. 1358] states 
that increases in the density and speed of the solar wind correlate with changes in K,. 
An increase in solar activity results in an increase in the number of particles captured 


by the earth's geomagnetic field. One result of this process is more auroral absorption. 








Figure 2. The auroral oval and the propagation path from Clyde River to site O. 


In addition to the auroral absorption, communication signals at high latitudes 
may follow non-great-circle (NGC) propagation paths. At lower latitudes IIF signals 
generally follow a great circle path from transmitter to receiver. High latitude signals 
can be reflected in a direction that is perpendicular to the great circle propagation path. 
Hlunsucker [Ref. 7: pp. 348-351] states that NGC propagation may be attributable to 
sidescattcring due to irregularities in the ionosphere. The incidence of NGC modes have 
been found to vary with the amount of magnetic activity. The final result for the com- 
munications engineer and the AMBCOM user is that signal strengths predicted by a 
model may not match measured signal strengths because the effects of NGC are not in- 
cluded in the model. During times when magnetic activity is high, the inability of the 
computer-based model to accurately predict signal strengths at given frequencies may 
be attributable in part to non-great-circle paths. 

‘The occurrence of sporadic E (£,) at higher latitudes is important to communi- 


cation in the TIF band. £, provides additional paths for propagation at HIF frequencies 
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Figure 3. A typical day in auroral absorption. [From Ref. 10: p. 1361] “ 


as well as some attenuation of signals propagated by other modes. Ilunsucker [Ref. 7: 
p. 353] described the effect of E, resulting from measurements taken for propagation 
paths between Thule (Greenland) and College (Alaska) as well as for a path from 
Andoya (Norway) and College as follows: 

In particular, for winter-night sunspot minimum conditions on the Thule-College 

and Andoya (Norway)-College path, £, modes had an average occurrence over 50%. 

E, MOF'’s as high as 46 MHz with typical values of 18 MIIz were observed. 
As can be seen in Figure 4 on page 8 the percentage of sporadic E varies with time and 
latitude. In the auroral oval the average percentage of E, is at a maximum during the 
evening hours and at its lowest at noon. Hlunsucker [Ref. 7: p. 351} states that EZ, is more 
prevalent and with higher maximum observable frequencies (MOF’s) during the winter 
months compared to summer months. £, was included in some path calculations made 
by AMBCOM. In addition some effort was made to adapt the percentage of E, to the 
time of day and year. The results from £, calculations were then compared to data from 
AMBCOM which included no E, calculations. (Ref. 7: p. 351} 

The polar ionosphere does include F layers similar to those found at the 
midlatitudes. The distinction between the polar F2 layer and the F'l layer may not be 
as dramatic as at lower latitudes. FI mode propagation is frequently observed during 
the summer, especially in the morning. This is because the F2 layer critical frequency 
decreases with increasing latitude at a faster rate than the FI critical frequency. [Ref. 7: 
p. 335]. The Fi mode is the dominant means of long-range propagation during periods 


of low sunspot activity, particularly during the low end of the eleven year sunspot cycle. 
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Tigure 4. The average percentage of sporadic E by geographic latitude and time of 
day. [From Ref. 7: p. 352] 


Vondrak [Ref 9: p. 38] noted that the ionization density profiles recorded by the 


Chatanika radar showed a valley between the E layer and the F2 layer when the layer 


was not sunlit. This valley disappeared during the day and during periods of high particle 


precipitation. 


C. PREVIOUS PROPAGATION MODEL STUDIES 

How accurately can high latitude propagation be predicted using the computer 
models that are presently available? Presently there is not a complete answer to this 
question. Although individual studies have been carried out comparing the output from 
computer models to the data recorded from transpolar and polar communication paths, 
these studies were not intended to be comprehensive comparisons of the accuracy of 


numcrous models relative to one another using one set of recorded transmissions. 








1. The Rockwell International Study 


During fiscal vear (FY) 1987, Rockwell International completed a transauroral 
high-frequency (HF) radio transmission experiment (TAHFE). The experiment con- 
sisted of recording, at Cedar Rapids, IA, transmissions from Barrow, AK. The trans- 
missions were made by stepping through a selected set of frequencies at specific times. 
Figure 5 on page 10 is a block diagram of the equipment used for this experiment. 

In addition to the transmissions, data were recorded which described the 
ionosphere, solar activity and HF channel parameters at any given time. 
Solar geophysical data were collected from the U.S. NOAA Space Environment Services 
Center (SESC) [Ref. Il: p. 2]. The HF channel parameters where measured by Rockwell 
International engineers using the advanced link quality analyzer (ALQA). These data 
were recorded on computer disk for later analysis. Using SESC data and with the aid 
of solar event alerts from the Geophysical Institute at Fairbanks, AK, the experiments 
were able to match measured channel parameters to solar activity. [Ref 11: pp. 1-3] 

Three computer models, i.e, IONCAP, MINIMUF and AMBCOM, were used 
to generate predicted maximum useable frequencies (MUF) using the recorded solar- 
geophysical data as a primary input for the prediction models. All models produced 
good approximations of MUF values that were actually recorded during the experiment. 
AMBCOM was able to predict the effects of solar events upon the transpolar path such 
as the a communications blackout on 12 November 1986. [Ref: 11] 

2. High-Latitude HF Predictions From RADAR C and AMBCOM 

Nikhil Dave of the Naval Ocean Systems Center (NOSC), San Diego, 
California, conducted a comparison of the data produced by two models (RADAR C 
and AMBCOM) and polar sounder data recorded for the Winipeg-Resolute Bay path 
during 1959 and data recorded during 1964 over the two paths (Andoya-Ft. Monmouth 
and Andova-College during 1964). The former data were recorded during a period of 
high sunspot activity and the latter data during a period of low activity. The intent of 
the study was to produce a predicted MUF and to compare it with recorded data. 
AMBCOM was found to be more accurate than RADAR C because AMBCOM in- 
cludes adjustments for auroral absorption and other polar anomalies. [Ref. 12 ] 

3. The Naval Postgraduate School Studies 

The work at the Naval Postgraduate School was intended to compare the per- 
formance of as manv models as possible to the same measured data, antenna gain, and 
control parameters. NPS students examined the relative performance of IONCAP, 
PROPHET, and AMBCOM. In the future, a new high-latitude propagation model, 
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Figure 5. TAHFE equipment suite that was used for the Rockwell experiments. 
[l‘rom Ref. $1] 


ICEPAC, will be studicd. The comparison of data generated by IONCAP and 
PROPIIET were completed and published [Ref. 13 and 14 ], and may be compared to 
this AMBCOM analysis (sce Appendix 1D). Jt is hoped that the results of these studies 
will guide the future creation of a standard model validation data base and the estab- 


lishment of guidelines for computer-based propagation prediction model evaluation. 
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Il. THE AMBIENT COMMUNICATIONS MODEL (AMBCOM) 


A. INTRODUCTION 

This chapter provides a brief description of applicable portions of AMBCOM. De- 
tails of the internal functioning of AMBCOM are contained in the user’s guides pub- 
lished by SRI International [Ref. 15, 16 and 17]. 

AMBCOM is designed for batch processing using card images as input. Separate 
programs support each of the function areas modelled, i.e., the ionosphere model is 
gencrated by a program which passes its data to another program for ravtracing calcu- 
lations. The system flow is first explained followed by the programs and inputs which 


generate the high latitude data. 


B. SYSTEM FLOW 

The AMBCOM system is a multiprogram batch system written in FORTRAN and 
was run on a VAX 3100 workstation at NPS. Programs NATGEN, RAYTRA, and 
COMEFF were used to generate the high-latitude data, as shown in Figure 6 on page 
12. Data are passed between these programs by means of saved data files. [Ref. 15: 
pp. 107-155] 

Since AMBCOM programs pass data through standard files, the user must be care- 
ful with regard to the timing of program execution. Several campaigns were modeled in 
this study. If two campaign decks were executed simultaneously and the programs did 
not terminate due to file access collisions, then the accuracy of the contents of a passed 
file could not be guaranteed. The user has the option of either changing the names of 
the passed files so that these file names differ from one campaign input stream to an- 
other or to simply run one campaign input stream at a time. The latter method was 
chosen so .iiat each execution of AMBCOM would not share the assets of the VAX 
3100. 

The execution input stream.- were constructed for all 25 days of a particular cam- 
paign in only one computer run. Separate AMBCOM input streams were created for 
each site during the campaign. This entails the construction of an input stream for 
NATGEN, RAYTRA, and COMEFF, representing each KX, three-hour interval and 


eight intervals per day for 25 days. Each campaign input stream was approximately 


13,300 lines in length, and required two and half hours of execution time. 
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Figure 6. AMBCOM system flow showing the passage of data between programs. 


The data produced by AMBCOM for cach of the three hour intervals was accumu- 
lated:in files for later processing. This is not a problem because the VAX 3100 work- 
station allows the use of multiple gencration data sets. These data sets were casily 
concatenated at the end of the campaign’s execution stream into one large file repres- 


enting all the data for one campaign. 


C. NATGEN 
I. Overview 

The purpose of NATGEN is to model the ionosphere along the commuzhication 
path between two points. NATGEN builds a model of the F2, Fl, and E layers at 
control points along the path. The control points are evenly spaced at 100 km incre- 
ments with a maximum of 41 control points for paths longer than 4000 km. The control 
points are not necessarily located at the signal reflection points since raytracing is per- 
formed in RAYTRA. [Ref. 15: pp.23-24] 

NATGEN begins by reading ionospheric coefficients provided by the Institute 
for Telecommunications Sciences (ITS) in Boulder, Colorado, based upon the month, 


day, and the current sunspot number. AMBCOM uses the ITS Blue Deck! as the 


i A reference to earlicr coefficient files that were issued on color trimmed computet ‘cards. 





starting point for the modeling of the F,, F, , and E layer at each control point. Addi- 
tional parameters describing atmospheric noise, ground conductivity, and ground 
permitivity along the path are read and passed to RAYTRA. [Ref. 15: p.23] 

The semithicknesses, heights of maximum ionization, and the critical frequencies 
for the F,, F, and E layers at each of the control points are passed as outputs from 
NATGEN. ITS upper, median and lower decile values for sporadic E critical frequencies 
are passed to RAYTRA which performs all E, calculations. NATGEN also passes on 
the location of the transmitter and receiver sites, the time of year, time of day, the cur- 
rent K, index, the sunspot number, distance between control points, the number of 
control points, and the path length. (Ref. 16: pp.123-124] 

2. Layer modeling 

The ITS provides the vertical incident critical frequency (f, ) for the E layer, the 
F, layer, and sporadic E. The E layer critical frequency (f,£) is always set to the median 
decile values. For the sporadic E and the F, 
laver, the upper, median, and lower decile values represent the critical frequencies 90%, 
50%, and 10%, respectively, of the days for a given time and month [Ref. 18: p.89]. 
NATGEN allows the user to choose which of the F, layer values will be used as the F, 
critical frequency (f,F2) for all ionospheric calculations. The default £F2 value is the 
median decile number. Two additional parameters for the F, layer are the ratio of the 
semithickness of the layer (y,,) to the height of maximum density (#,,) and the maximum 
usable frequency for a 3000 km path (M3000). (Ref. 15: p.25] 

Using these coefficients, AMBCOM models the ionosphere at the control 
points. The F,, F, and E layers are represented as three parabolic layers with the values 
for the F, laver derived from the F, and E laver models. The height and semithickness 
of the E layer are set at 115 km and 25 km respectively. The F,layer height is calculated 
using the ITS coeffiiients in a two step process. First the peak height of the F, layer ( 
HP) is calculated using the Shimazaki equation [Ref. 15: p. 26] 
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This value is corrected for signal retardation with a height factor (AA) equation [Ref. 
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where 
Ah = the height error, 
f. = the critical frequency of the layer, 
= the transmitted frequency and 


Sn = the semithickness of the laver. 


The AA factor is then subtracted from HP, to produce a corrected height for the F, layer. 

The F, layer parameters are not represented by ITS data but are calculated using 
the E and F, layer parameters. The F, laver must overlap the F, layer by half of its own 
semithickness with the bottom of the F, laver set at 130 km. The critical frequency of 
the F, laver is calculated based upon the critical frequency of the E layer (Z£). In the 
event that the F, layer critical frequency is lower than that for F, 
JF lis set to 0.695 f(F2. [Ref. 15: p.27] 

3. High-Latitude Corrections 

Before any correction for high-latitude propagation paths can be made 
NATGEN must define the auroral oval using the Miller-Gibbs model [Ref. 15: pp. 
28-30] with a value for the width of the oval in the path (X) and the location of the lower 
boundary of the oval (¢,). The lower boundary is 


io) 
4 = TLS = 2.5K, — 5.1 608] FE (tq — | (5) 
and must lie between the boundaries 
° P 27 
min = 68.9° — KK, 5.1 cos| 32 (tn — | (6) 
and 
° 2z 
@max = 70.9° —K, — 5.1 cos| 2p = 1) | (7) 
where 


t, = geomagnetic time. 
The width is calculated as 


A= 7.0° — K,. ve (8) 














The oval width is limited to between four and six degrees of latitude. 

NATGEN is designed to accommodate propagation modeling at high latitudes 
by correcting critical frequencies for the F, layer (f,F2) and the E layer (ZZ). Corrections 
are made to f,F2 if the geographic latitude of the control point meets one of the follow- 
ing criteria: 

¢ The point is located at greater than 45° North (corrected geomagnetic latitude 
(4,,)). 
e The point is located within the auroral oval. 


e The point is in the nighttime midlatitude trough. 


All the points used in this thesis are north of 45°N latitude and so the first criteria always 
applies. The correction applied to f{F2 at high latitudes is a two step process. First 


J,F2 1s adjusted according to the first criteria above using 
Sof 24 =SoF2irs (l - xp] ’ (9) 


where 
fF2, = f,F2 adjusted for high latitude, 
S.f2irs = the F2 layer critical frequency from the ITS file and 


bx, 18 a function of K,. 


All other corrections are applied to this adjusted value. [Ref. 15: p. 29] 

The second step is,to adjust (F2 if the control point is in the midlatitude trough 
or the auroral oval. All control points that are north of the equatorward edge of the 
auroral oval are considered auroral oval corrections. Auroral oval adjustments are cal- 
culated based upon the location of the control point in reference to ¢, and X. The 


correction 1s calculated using the Miller-Gibbs equation [Ref. 15: p. 29] 
2 
[FL = foF2,| 1 + 0.4946 X, est (10) 
where 


X= Lam Py | : 


soy (11) 


This last parameter is the normalized distance referenced to the equatorward edge of the 
oval. (Ref. 15: pp.29-30] 





The correction for the midlatitude trough accounts for the effect of this region 
on f,F2. In this region the critical frequency can be as low as | to 2 MHz and a signal 
which enters this part of the ionosphere may penetrate into space. NATGEN makes 
corrections for the midlatitude trough only when the ionosphere is not sunlit, e.g., the 
solar zenith angle (y) is greater than 90° and the corrected geomagnetic time is between 
1800 and 0600. Reference 15, pages 30 thru 31, provides complete details of the cor- 
rection equations used by NATGEN. 

The high-latitude correction to f,E is much different than that for f,F2. This is 
due to the fact that E layer propagation at higher latitudes is dependent upon solar ra- 
diation and particle precipitation. The location of this auroral E zone will vary with the 
time of day and with magnetic activity. NATGEN compensates for this by first model- 
ing the boundary of the auroral E zone and then calculatine fF based upon the separate 
values for the E laver critical frequency due to so'u. radiaiion ((E(solar)) and particle 
precipitation (f,E(auroral)). [Ref. 15: p. 34-35] 

The local K index is an indicitor of nerticle precipitation which results in higher 
E layer ionization densities. The magnetic field at higher latitudes is much different from 
that at midlatitudes and is not well represented by K,. The K, index reporting stations 
are mostly located in midlatitudes and therefore the index is weighted more heavily in 
favor of midlatitude values. Hatfield [Ref. 15: p.32-33] states that K, does not produce 
high latitude modeling results which correlate wel. with measured data, but using the 
local K index value does produce a stronger correlation to measured data. NATGEN 
has been adapted to estimate the local K index based upon the corrected geomagnetic 
latitude, the corrected geomagnetic time and the current K, index. This local K index 
value is used to calculate f,E(auroral). 

The final step of the process is to combine the value for (,E(solar) with that for 
f,E(auroral). According to Hatfield [Ref. 15: p.35] the final value for E is given by the 


equation 


AE = "VJ 1.5 f,E(auroraly’ + f,E(solar)’ . (12) 


The f,E(auroral) is given more weight than f,E(solar) since particle precipitation heavily 


influ. ces the E layer at high latitudes. 








4. NATGEN Input Variables 

AMBCOM is a batch system in which the input stream which controls the exe- 
cution of the svstem resembles a series of 80 column computer cards. AMBCOM was 
originally designed during the 1970s when card input systems still predominated [Ref. 
15: p.15]. Figure 7 on page 18is an example of statements used to execute NATGEN. 
The ASSIGN statements provide NATGEN access to the ITS file (ESSABLU.DAT), 
the conversion tables for the geomagnetic coordinate system (RAGCOT.DAT), two 
output files (IONOS.DAT and NOISE.DAT), and execution control cards one through 
four. 

AMBCOM provides a large amount of flexibility in the control of data pro- 
duction. NATGEN models the ionosphere along any propagation path at any hourly 
time increment specified by the numbered control cards. The AMBCOM user defines 
the problem by specifying the transmitter and receiver locations, the sunspot number, 
the K, index, the time increment, and the use of auroral layers. 

Control parameters were chosen to model the ionosphere, as closely as possible, 
to the Project NONCENTRIC transmission paths. The intent was to execute the model 
from the perspective of a communicator who is attempting to estimate the possibility 
of communicating with another HF site under a given set of circumstances. Although 
the communicator does not have the advantage of using the sunspot number and K, in- 
dex tables for a current month, he should have a rough estimate of the current sunspot 
number and K indices at any given time. 

Figure 7 on page 18 shows the four control cards used to execute NATGEN. 
Card one is used to specify the use of auroral particle densities for all layer calculations, 
and card two causes NATGEN to run the ionspheric generator program. Card three 
defines the geographic latitude and longitude of the transrnitter and receiver; negative 
numbers indicate a west longitude. Following the location information are the year, 
month, sunspot number, and K, index. Card four indicates the beginning hour, ending 
hour and time increment. 

Input streams were divided into three hour periods over a 25 day period. This 
was for modeling the ionosphere during each of the three hour K, index periods 
throughout the day. The values for sunspot number and K, index were taken from the 
Journal of Geophysical Research [Ref. 5, 19, 20, and 21]. The days of the month and 


hourly time increments were derived from Project NONCENTRIC data. 


17 
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Figure 7. NATGEN control cards used to model winter site O propagation data . 


D. RAYTRA 
I. Overview 

The raytracing program (RAYTRA) model is divided into two modes, point- 
to-point and radar. The point-to-point mode performs raytracing from a transmitter to 
a receiver and was used for this thesis. RAYTRA computes group times, phase time, 
signal losses, the cflects of sporadic I: and elevation angles at both points. These data 
are saved for each successful propagation path and are passed to COMEFF. 

The raytracing algorithm computes the propagation path based data produced 
by NATGEN. A raytrace which ends within 1000 km of the receiver site is saved for 
further processing. When two rays bracket the receiver, the program interpolates a ray 
that falls within some preset value, in this case ten kilometers. The parameters describ- 
ing this ray are saved for COMEFF. In the case where only a single ray 1s found, the 


program again interpolates until a ray close to the receiver is found. The AMBCOM 








User’s Guide For Engineers [Ref. 15: pp.35-56] provides an in-depth treatment of 
ravtrace algorithms. 
RAYTRA estimates the amount of absorption for each ray. The absorption 
calculations are divided into four parameters as follows: 
e Ly is the divergence, i.e. free space spreading loss. 
e lL, 10nospheric absorption loss such as deviative, nondeviative, and auroral losses. 
e L,, 1s the loss resulting from sporadic E. 


¢ L, is the loss due to ground reflections along the path. 


The total loss for a path is the summation of all of these factors. Only ionospheric ab- 

sorption as it applies to auroral absorption will be described here. A full explanation 

of the RAYTRA path loss algorithms may be found in Reference 15, pages 56 thru 80. 
2. Auroral Absorption. 

RAYTRA models the auroral absorption using a modified Foppiano model 
[Ref. 15: pp. 64-71]. The adaptations made to this model by SRI provide the mode} with 
some Gependence upon the X, index. Auroral absorption is related to particle precipi- 
tation which is, in turn, heavily influenced by the activity of the geomagnetic field and 
K, is a descriptor of the current state of the planetary magnetic field. The sunspot 
number (which is used by the Foppiano model) does not correlate well with changes in 
the magnetic field and it is not a good indicator of the amount of auroral absorption 
present. 

The Foppiano model produces a median value for auroral absorption based 
upon the combined effects of substorm activity for a given hour of the day in a given 
month, and upon the level of solar activity. Solar activity is modeled with a 12 month 
running average of sunspot numbers which do not relate directly to geomagnetic field 
activity. Large variations in auroral absorption can be lost in the averaging process. 
On the other hand ihe addition of a large dependence upon K, could cause the model to 
produce incorrect results for quiet day predictions. SRI cliose to include the K, index 
by the use of a normalized Gaussian distribution so that the location of the maximum 
amount of absorption is dependent upon K, but the magnitude of the maximum is not 
dependent upon A,. [Ref. 15: pp. 64-65] 

RAYTRA begins auroral absorption model by first calculating the factor Q, 
which is the one-way vertical absorption at 30 MHz that exceeds 1 dB. A riometer is 


used to measure changes in ionospheric absorption, at 30 MHz, in reference to quiet day 








absorption levels. For RAYTRA the Q, factor is calculated from two other variables 


as 
Q1= Mat As (13) 
Q\g= 21 dy x dy x dp X dy X d,, (14) 
and 
Q1,= 12s, x Spx Sp X Sp X Sms (15) 
where 


d/s, = the drizzle/splash precipitation latitudinal dependence, 
al sr 


a/sp = the drizzle’splash precipitation sunspot dependence, 


the drizzie/splash precipitation time dependence, 


a/s, = drizzle'splash precipitation longitudinal dependence and 


d/s,, = the maximum latitude of drizzle/splash precipitation. 


m 


The term splash particle precipitation is associated with discrete ionospheric events that 
are limited spatially. Drizzle refers nearly constant and widespread particle precipitation 
that results from particle collisions in the upper atmosphere [Ref. 22: p.322]. The sub- 
scripts Id and Is refer to drizzle and splash precipitation, respectively. The only pa- 
rameters modified for K, dependence are d,, s,, and d;, which are the latitude of the 
drizzle component, the latitude of the splash component, and the time dependence. The 
remainder of the Foppiano model has not been modified. [Ref. 15: pp. 64-66] 

The lautude of the drizzle component of the model is calculated with the 
equation [Ref. 15: p. 66] 


7, — 2 
toon] eet | a 


2 
20% 


where @,, is the latitude of maximum absorption and 9, is the latitudinal extent of the 
absorption zone. The K, influence is introduced with the equations [Ref. 15: p. 66] 


(17) 


es —0.6256K, ;K,<5 
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3.06 + .2765K, iKy <5 


2 18 
20) AGS OGK YR S15 mm 


The K, influence for the time dependence is introduced similar to that for ¢,,. 


The time dependence is given by 


peed 
dp= enn] Set | (19) 


where 


9.9-0.46K, ;K,>5 
m= (20) 


15.6—1.6K, 3K,<5. 


Both d, and d, are normalized Gaussian functions. [Ref. 15: p. 67] 
The calculation of the splash component (s,) is also performed with a normal- 


ized Gaussian equation as follows: 


2 
Sy = exp ie Sil ; (21) 
20% 
where 
é 66.799 — 0.9246K, + (0.318 + 0.0828) |1]  :K, <5 s 
‘| 78,256 — 3.216K, + (.288K, —.708)|¢| 5K, >5 ” 7 
T-3 <T<15 
t= (23) 
T-—27 315<T<24 


and T is the corrected geomagnetic time. This component value along with the others 
is used to produce Q),. [Ref. 15: p.68] 

Q, is used to calculate the median absorption value A, , which must be adjusted 
from a monthly median value to one corresponding to K,. The final value for absorption 


is obtained from 
Axp = Yrp Ain 4 (24) 


where 
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Ygp = 1.8(0.17 + 0.14K;). (25) 


The factor of 1.8 was included to scale the equation to match high latitude empirical 
data. [Ref. 15: pp.69-71] 


3. Sporadic E Calculations 

RAYTRA offers two choices for computing sporadic E (£,). The first method 
computes the reflection of signals for frequencies below the blanketing frequency (/,E£,). 
The blanketing frequency is computed based upon the location of the control point. 
The second method performs £, reflection calculations for all frequencies less than /-E.. 
The value for (E, is based upon the upper, median, or lower ITS /(E, coefficients passed 
from NATGEN. The choice of value is specified by the user. RAYTRA calculates fE, 
dependent upon the percentage of E, specified by the AMBCOM user. If 90% E, is 
specified then RAYTRA uses the upper decile value of (E, from the ITS file. For 50% 
E, RAYTRA uses the median decile value. None of these E, models were designed to 
simulaied sporadic E at high latitudes. (Ref. !5: pp.53-56] 

RAYTRA offers two models for sporadic E (£,) in reference to absorption loss, 
the Sinno model and the Phillips model. Based upon the work of Hunsucker (Ref. 7: p. 
351], the author decided to examine the effect of differing amounts of E, on the gener- 
ation of the model data. The Sinno model was chosen because it allows the user to 
choose which of the decile values to use for /,E, for all sporadic E calculations. The 
Phillips model uses only the median decile value. [Ref. 15: pp.71-77} 

4. RAYTRA Input Variables 

RAYTRA, like NATGEN, provides the user with a number of options for 
controlling program execution. Options are specified with numbered control cards in- 
stream following the program execution statement. Figure 8 on page 23 is an example 
of the RAYTRA controlling statements used for this thesis. 

Card two controls the amount of E, for a given execution. Three different types 
of input streams were chosen per campaign for comparing model accuracy as the per- 
centage of E, is varied. Figure 8 on page 23 is an example of a modified sporadic E in- 
put stream. The number 70 in columns 49-50 indicates a value of 70% fEs will be used 
for all raytracing and loss calculations for sporadic E during the time period specified 


by the preceding NATGEN program. 
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Figure 8. RAYTRA input stream used to model winter site O propagation data. 


Project NONCENTRIC Site O data was compared to data generated by 
AMBCOM using 0% sporadic E calculations, 50% sporadic E, and modified sporadic 
E. For modified £,, the percentage was varied during the day. During the six hour pe- 
riod around midnight 90% E£, was used, 70% during the three hour periods before and 
after the 90% window. RAYTRA was allowed to default to 50% for all other hours 
during the day. For the 50% sporadic E runs, RAYTRA was allowed to default to the 
median ITS f,E, value. The sporadic E feature was turned off for the 0% E, input 
streams. 

Frequencies for RAYTRA are specified by control card four. Frequencies from 
Project NONCENTRIC were used in RAYTRA to enable automated comparison of 
model and measured data. The automation of the comparison and statistical analysis 
process reduced the amount of time required to examine the results of a single execution 
and allowed more time for experimenting with the effects of changing control parame- 


ters. 











E. COMEFF 
l. Overview 
The communications effect (COMEFF) program evaluates the quality of a 
transnutted signal. Previously discussed programs, e.g., NATGEN and RAYTRA, dealt 
with the ionosphere and possible ionospheric effects along a given propagation path. 
The only site-dependent information required for those two programs were the site lo- 
cauons. COMEFF factors include transmit power, antenna configuration, signal band- 
width, and other communication site-dependent data. Based upon these local 
parameters and the data produced by RAYTRA, the performance of a particular com- 
munications link using given a frequency can be characterized in terms of the signal-to- 
noise ratio (SNR), field strengths and doppler spread. 
2. Program Features 
COMEFF uses the data generated by RAYTRA for all of the saved modes as 

the basis for evaluation of a particular communications link. The raytrace descriptive 
data, for each ray, includes: 

e take-off angle, 

@ group time, 

e phase time, 

© path loss, 

® noise power (per | Hz), 

¢ arrival angie and 


* transmitter frequency [Ref. 15: p.112]. 


Multiple raytraces mav be described for each frequency. COMEFF combines the effects 
of multiple modes to produce a single reception statistic. 

COMEFF allows the user to include the effects of the antenna configuration 
on the communications link. The antenna data is taken from ANTLIB.DAT, the 
AMBCOM antenna file. Unfortunately the antennas required for this thesis were not 
in the standard SRI antenna file. The antenna patterns for this thesis were taken from 
References 14 and 13 and adapted for use in AMBCOM. This is a manual process since 
AMBCOM< does not provide the user with a program for entering the antenna data. 
Appendix A contains the antenna gain tables used for the summer and winter Clyde 
River-Leicester campaigns. 

The communications effect program provides a variety of output options. 
COMEFF will calculate the signal-to-noise ratio (SNR), group time, doppler shift, 
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phase, and delay spread for all frequencies specified in RAYTRA. Other options provide 
field strengths or analvsis of signal quality, e.g. the bit error rate. All requested data 
may be printed in several formats which include a listing of SNR, doppler shift, phase 
shift, and group times for each mode COMEFF also produces a single report that sums 
the data for each frequency at a particular ime. The SNR specified in the COMEFF 
summary report is a weighted accumulation of SNRs for all modes received from 
RAYTRA. 

Weighted SNRs from the COMEFF summary report were compared to meas- 
ured SNR values. This composite SNR is calculated bv computing the power for each 
rav, combining these values and then subtracting the noise value. The power 4, for each 
ray 18 computed with the equauon 

P.G,G,¢? 


A, => anloele 10! phi 10] ’ (26) 


where 


p = transmitter power (W) 


i 


transmitter antenna gain, 
G, = receiver antenna gain. 

L, = path loss for the ith ray, 
e 


= receiving antenna loss and 


{ 


= frequency (MEI{z). 


The composite SNR value is given by the equation 


SNR = 10 loBio( > Ai) — No (27) 


where .V, 1s the noise power density in dBW. (Ref. 15 : p.83] 
3. COMEFF Input Variables 

Figure 9 on page 26 is an example of the COMEFF input stream. Two control 
cards are used to control program execution. The first card specifies transmit power, 
path loss threshold, and the use of antennas. Transmit power is given in units of watts 
per hertz. A bandwidth of 50 Hz and a transmitter power output of 400 watts results 
in 8 W Hz. The path loss threshold is used to exclude modes with a path loss greater 
than the specified threshold. This parameter was set at 400 dB which effectively allowed 
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all modes to be included. The second COMEFF control statement is used to specify 


antennas, 


S$SET DEF DKAO: [AMBCOM] 

SASSIGN SYSSINPUT FORO5S: 

SASSIGN DKAO: {WILSON]WAVEFORM.DAT FORO20: 
SASSIGN DKAO: [WILSON]JCOMOUT.DAT FOR059; 


SASSIGN DKAO: [AMBCOM]COMEFF.DAT FOROO7: 
$ASSIGN DKAO: [AMBCOMJANTLIB.DAT FOROO6: 
$R DKAO: [ AMBCOM]COMEFF 
NONCENTRIC 18 JANUARY 1°¢°S 
0 0. 1600 1 4 
WHIP SLOPEVEE 





Figure 9. COMEFF control input used to model winter site O propagation data. 


Il PROJECE NONCENTRIC 


A. STTES 
I. Overview 
Project NONCENTRIC was a study of communications at ITF frequencies at 
high latitudes conducted by the University of Leicester, U.K. The concept of the project 
Was to place a transmitter in the polar cap area and to transmit [II signals to receivers 
at several locauons in polar cap and nidlatitudes regions. Figure 10 shows approximate 


locations of transmitter and receiver sites. Table 1 on page 28 provides locations of sites 


in geographic latitude and longitude. 





Figure 10. The Project NONCENTRIC site locations and propagation paths. 


The equipment configuration used for Project NONCENTRIC recciver sites 
varied from site to site. No data are available which accurately describes the recciving 


equipment, distribution systems, or antennas in operating environments. Data produced 








Table 1. RECEIVER SITE LOCATIONS 












by AMBCOM were not adjusted to account for site-dependent anomalies. The data 
produced for sites C and D exhibited large average crrors at higher frequencies, 1.e. 30-40 
dB. It was assumed that site noise may have lowered the measured SNR, and the site 
C and D AMBCOM SNRs were adjusted down 15 dB to account for noise in the re- 
ceiver system. 

The geometry of all the Project NONCENTRIC antennas are recorded, but 
none of the antenna patterns were measured at their specific site. No measurements 
were taken of site noise levels, ground permitivities, or ground conductivities. All an- 
tenna patterns and local noise levels used to generate AMBCOM data are estimated. 

2. Transmitter Site 

The transmitter site was located at Clyde River, Canada. Clyde River is located 
within the polar cap region at 70° north latitude and 69° west longitude. Propagation 
data used for this thesis are from midlatitude receiver stations so paths from Clyde River 
must pass through the auroral oval region. The Clyde River site transmitter power 
output level was 400 watts. 7 

Two different antenna configurations were used at the Clyde River site. During 
the summer campaign of 1988 a modified BUTTERNUT two-trap antenna (type 
HF6V-X) was used for all transmissions. The winter campaign employed a resistive 
whip antenna. These two antenna geometries were modeled by Tsolekas [Ref. 13: pp. 
11-16] using descriptive data provided by the University of Leicester. The antenna 
models were created using the Numerical Electromagnetics Code, Version 3 (NEC-3) 
using the Sommerfield-Norton approximation for a finite ground plane. The results from 
this modeling process were used to construct antenna gain tables used by AMBCOM. 

3. Receiver Sites 
Site O (University of Leicester) files were the only sources used for the earlier 


works by Tsolckas [Ref. 13] and Gikas [Ref. 14]. In order to compare their results with 
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the data produced by AMBCOM the same site data and antenna configurations were 


emploved. This thesis also includes some comparisons of data generated by AMBCOM 
for sites C and D. 

Site O was equipped with a sloping vee antenna for all Project NONCENTRIC 
campaigns. This antenna was modeled by Gikas {Ref. 14: pp.10-16] using NEC-3. Gikas 
used the antenna geometry provided by the University of Leicester p!us estimated values 
for permitivity and conductivity as inputs to NEC-3. The final form of the antenna gain 
tables for AMBCOM are interpolated from the results produced by Gikas for each of 
the Project NONCENTRIC frequencies. 


B. PROJECT NONCENTRIC DATA 
1. Signal Format 

Project NONCENTRIC data were taken from two of the four high latitude 
campaigns. The summer and winter campaigns were conducted 17 July-12 August 1988 
and 18 January-12 February 1989 respectively. The data were collected from three sites 
which are labeled as sites C, D, and O. 

Project NONCENTRIC signals were transmitted over a range of frequencies 
by stepping from 3.2 MHz to 23.9 MHz at preset time intervals. These transmissions 
were formatted to provide a repetitive pattern of signal forms which could easily be re- 
cognized; Figure 11 on page 30 is a diagram of the signal format. The call sign (CS) 
was sent in morse code at five second intervals. The Barker code sequence consisted of 
a bipolar code with bit length of 250us repeated continuously during a 30 second inter- 
val. The Doppler signal represents 30 seconds of transmission with an unmodulated 
carrier. The call sign and Doppler signals were used for signal analysis by the automated 
signal recognition process used by the University of Leicester. 

2. Project NONCENTRIC Data Analysis 

An automated signal recognition program was used by the University of 
Leicester to validate the received transmissions and separated the data into the five files 
shown in Table 2 on page 30. The automated signal recognition process was validated 
by comparing the data from the five files with the results obtained by manual signal se- 
lection of a small subset of received transmissions. The automated signal recognition 
program was in agreement with manual selections about 80%-90% of the time [Ref. 
23: p. df. 
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Figure 11. The time sequence of the Project NONCENTRIC signals showing 


Doppler and call sign sequences. [From Ref. 23] 


Table 2, PROJECT NONCENTRIC WINTER/SITE O FILES 
FILE DEVINITION 
Passed all test: valid data 
OWINTER ES 
Data judged to be interference 
Data that failed all tests 



















3. Spread Index Test 
The spread index test provides a simple method for judging the amount of 
Doppler spreading for cach signal. The method entails an analysis of the Doppler por- 


tion of the transmitted signal by observing the frequency shift of an unmodulated carrier 
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with time. The amount of Doppler spreading is indicated the observed frequency shift 
of the unmodulated carrier during a 30 second transmission. A noise spectrum, assum- 
ing a uniform noise distribution, would not be expected to exhibit the same spectrum 
as an unmodulated carrier with Doppler spreading. The spread index test takes advan- 
tage of this property to separate possible valid signal data from noise data. [Ref. 23: p. 
1] 

The spread index test is a multiple step process. The received signal's spectrum 
is first obtained from a 1000 point Fast Fourier Transform (FFT). Figure 12 on page 
32 is an example of the resulting spectrum. The mean signal amplitude between -25 Hz 
and -12.5 Hz is taken as the mean noise level for the signal. This mean noise level value 
is subtracted from the spectrum to yield the form shown in Figure 13 on page 33. The 
area under the remaining signal is defined as the spread index. Since the spread index 
is proportional to the width of the remaining signal it is also proportional to the Doppler 
spreading of the signal. 

The spread index is used in conjunction with the signal strength to determine 


signal validity. The selection criteria are as follows: 


e A signal passes the spread index test if the spread index is large and the signal 
strength is greater than a preset threshold value. 


¢ The signal is invalid if the spread index is negative. 
e The signal is invalid if the spread index and signal strength are small. 


e The signal is valid if the spread index is small and the signal strength is large. 


All signals were passed to the call sign test regardless of the results of the spread index 
test. 
4. The Call Sign Test 
The call sign test provided a further means of validating data. The signal spec- 
trum was produced with a 1000 point FFT. The mean noise level (N,) was computed 
by examining the frequency spectrum from -50 Hz to -12.5 Hz. The value of the mean 
noise (N,) used for the call sign test is increased to insure that a call sign signal mainlobe 


and sidelobes are present. The call sign mean noise value is given by 
Ny = 2.5 Nj. (28) 


The value NV, is subtracted from the signal spectrum to produce the call sign signal. 


Figure I4 on page 34 is an example of the call sign spectrum after the mean noise level 
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Yigure 12. The Project NONCENTRIC signal spectrum after the 1000 point FFT. 
{From Ref. 23] 


isremoved, This signal is then examined to determine if it matches the call sign pattern. 
[Ref. 23: p. 2] 
5. Interference 
The automatic signal recognition process was designed to detect interfering 
signals and to mark the transmission data accordingly. A signal is considered interfer- 
ence if it passes the spread index test but fails the call sign test. A signal-to-noise ratio 
(SNR) greater than 10 dB should pass the call sign test. If it fails the call sign test then 
the signal is considered to be interference. A signal is considered invalid with a SNR less 
than 10 dB. [Ref. 23: p.3] 
6. Signal Categorization 
The tested data are categorized and stored in one of five files. The file categor- 
ization criteria 1s as follows: 


e The data passes both tests and is written to the signal (SIG) file. 














Figure 13. The Project NONCENTRIC FFT Spectrum with the average noise re- 
moved. |From Ref. 23] 


e The data failed both tests and is written to the nonsignal (NOS) file. 
e The data passes the spread index test only; the data is saved in the spread index file 
(VSI), ‘ 


e The data passes the spread index test but is determined to be interference; the data 
is Written to the interference (INT) file. 


e The data passes the call sign test only; the data is written to the call sign (FCS) file. 


The data from the SIG files were used to compare with the AMBCOM generated data. 
{Ref. 23: p. 3] 

Each of the receiver sites used for this thesis produced its own set of five data 
files, e.g.. SIG, NOS, FCS, FSI, and INT. The data are arranged in ascending order 
with respect to time. Table 3 on page 35 lists the attributes of each of the data elements. 

The PEAK and NOISE units are one of the major problems with the Project 
NONCENTRIC data. The two values for these two elements are taken fromthe 1000 


point FFT and they cannot be translated into the field strength and noise power values 
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Figure 14. The Project NONCENTRIC call sign spectrum produced by the 1000 
point FFT. [From Ref. 23] 


present at the antenna. Fortunately PEAK and NOISE are both in units of dB/uwV. The 
signal SNR is obtained by subtracting NOISE from PEAK. This SNR value was then 
compared to the AMBCOM SNR values produced for the COMET’ summary report. 
7. The Signals File Data 

The end product of this collection and analysis was the SIG file, which repres- 
ents a very small portion of the total number of signals recorded during the Project 
NONCENTRIC campaigns. For example, the file OWINTER.SIG, the valid winter 
campaign signals received at site O, contains only 38 records out of a population of 609 
received signals at 3.2 MUJz. ‘The highest number of records for a particular frequency 
is 266 out of a population of 609 at a frequency of 14.4 MHz. The signal files used for 
this thesis are a small sample in comparison to the total number of signals that were 


received. 
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Table 3. PROJECT NONCENTRIC DATA ELEMENTS 
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IV. AMBCOM DATA ANALYSIS 


A. ANALYSIS METHODOLOGY 
1. General 

AMBCOM produces data which exhibits different trends as frequency is 
changed. Summary statistics, produced through manual analvsis methods, tend to 
smooth over detail information about each frequency. An automated means of com- 
paring AMBCOM data to measured data was designed to alleviate this problem. Com- 
puter programs compared AMBCOM data to Project NONCENTRIC data and 
accumulated statistics by frequency and sporadic E model. These statistics were then 
displayed graphically to highlight trends, by frequency, in AMBCOM’s performance. 

2. Data Synthesis 

Project NONCENTRIC data is in a format that is easy to manipulate with a 
computer but AMBCOM data is not. AMBCOM SNR data used for comparison was 
taken from the summary report produced by COMEFF. The data must first be removed 
from the report and stored in a form which simplifies the comparison process. Originally 
this task was performed manually by reviewing each line of the COMEFF summary re- 
port and erasing those elements that were not needed. A simpler method was pro- 
gramming the VAX Workstation to perform this function which is one of the purposes 
of the modify data program (MODDAT). 

MODDAT is called inside AMBCOM input streams which generate data for 
each campaign. It is executed once for each day or part of a day for which AMBCOM 
produces data. MODDAT concatenates all COMEFF summary reports for that dav 
and then removes the data required for comparison with the Project NONCENTRIC 
data , e.g., the hour, frequencv, and SNR. It also writes the month and dav on each 
record. Files produced by MODDAT are allowed to accumulate ‘until the end of 
AMBCOM input stream execution, when they are ail concatenated and sorted for later 
processing. 

3. Statistical Analysis 

The statistical analysis is a two step process. The first step compares the 
AMBCOM data with the actual (Project NONCENTRIC) data. The matched records, 
actual records with no corresponding AMBCOM records, and AMBCOM records with 


no corresponding actual record are written to separate files for later processing. Statis- 
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ucs regarding the average error, average SNR, number of matches, and number of misses 


of actual data are recorded. The final step accumulates statistics about the number of 
AMBCOM records which did not match an actual record. 

The first step in the statistical analysis process is performed by the FORTRAN 
program WILSTAT. WILSTAT matches AMBCOM data with actual data by com- 
paring the hour, month, dav, and frequency of each record. Those AMBCOM records 
which do not match actual data are written to a file for later processing. Actual records 
which do not match AMBCOM records are accumulated by frequency as misses. 

Each record that is matched is used to calculate, for each frequency, the average 
AMBCOM SNR and the number of matched records. All SNR values from AMBCOM 


matched data are accumulated in a table by frequency (SNR 


req) along with the total 


number of matched records (TOT,,,,.,) for that frequency. At the end of the program this 


table was used to calculate the average SNR per frequency (SNR,,,) using the equation, 


ave 


y's NRyreg 


Pe Rave = TO Fnaich 


(29) 
A file, ordered by frequency, is produced which lists the average SNR, total number of 
matched records, and the average error. 

The average error values are compiled from the error values recorded for each 
record. Once an AMBCOM record is matched to actual data, the error (ERR,) is cal- 
culated by subtracting actual SNR (SNR,,.,) from AMBCOM SNR (SNRantcom)» The 
frequency, month, dav, hour, SNRonscom 9) Recon CTYOT, and spread index of all matched 
records are written to a file for processing with a graphics routine. The average error 


per frequency (ERR,,,) 1s given by 


: (> ERR) 


ERR, = 70T,* (30) 
where TOT, is the total number of records for that frequency. 

WILSTAT also calculates the percentage of matched records (P,9;). This value 
is the percentage of the total number of matched records (TOT) referenced to the total 


number of actual records (TOT,,,). The percentage is given by 


ect 
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it BOTs 
Pror= | ToT, | x 100. (31) 


This equation was used by Gikas [Ref. 14 ] and Tsolekas [Ref. 13] to produce their 
percentage of matched records. 

The second program of the statistical analysis process is called WILMAT.. The 
purpose of this routine is to accumulate the number of unmatched AMBCO™M generated 
predictions which were of acceptable transmission qualitv, e.g. AMBCOM predicts a 
strong signal for a time and frequency for which no signal was received. The key to this 
procedure is to select a proper threshold SNR value for acceptable signal quality. 
WILMAT performs this function by using the SNR,,, values calculated by WILSTAT 


as the transmission quality threshold for each frequency. 


ave 


WILMAT calculates the percentage, by frequency, of matching AMBCOM data 
(P,) referenced to the total number of AMBCOM predictions (TOT,) for a given fre- 
quency. All of the AMBCOM records used for this statistic must have a SNR greater 


than or equal to the SNR threshold for exceptable transmission quality. P, is given by 


TOT, ; 
P= TOT, + TOT, x 100. (32) 


This percentage was included in the model analysis to provide some basis for judging the 
reliability of a given AMBCOM prediction. 
Using the data produced by WILSTAT, WILMAT produces the final summary 

report which lists by frequency 

e the average SNR, 

e the average error, 

e the total number of matched records, 

e the total number of unmatched actual records, 


e the total number of unmatched AMBCOM records of acceptable transmission 
quality and 


e P, 


Appendix C is the compilation of these statistics by site and campaign. All FORTRAN 
programs written to process the AMBCOM data are listed in Appendix B. 
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B. AMBCOM INPUT STREAMS 

The 90% E, AMBCOM input streams are designed to roughly emulate a pattern of 
E, frequency distributions that were described in Reference 7. The largest percentage 
of E, should occur at approximately midnight local time in the auroral oval, with less 
E, at later times. These conditions are very dependent on the location of the reflection 
Points with respect to the auroral oval. £, is more intense within the aurora} oval than 
at the lower latitudes. No attempt was made to manually adjust the percentage of E, 
at each of the reflection points. The percentage of £, was defined for the whole propa- 
gation path and AMBCOM adjusted for latitude and frequency differences. 

The purpose of the 50% and 0% £, versions of the AMBCOM execution streams 
was to relate performance of the model with varving amounts of E£, included in 
AMBCOM calculations. The 50% £, data were modeled with using the median decile 
value for fE,. The 0° sporadic E data were created without using AMBCOM’s E, 
model. 

AMBCOM E, models are based on midlatitude £, critical frequencies from the ITS 
file. The resulting E, models are not specifically designed to describe high latitude spo- 
radic E. The reason for this is that the original data produce by the Chatanika radar site, 
on which AMBCOM is based, did not have sufficient resolution to detect sporadic E 
{Ref. 24]. The addition of a high-latitude E, model to AMBCOM is feasible and may 
be undertaken in the future; however, the effect cf using the current AMBCOM sporadic 


E model for high latitudes had not been examined before this thesis. 


C. WINTER DATA 
1. Site O 

AMBCOM Site O data showed a decrease in percentage of matched records as 
the percentage of E, was decreased to 0. The 90%, 50% and 0% &, data exhibited a 
Pryor Of 88.9%, 80.5% and 68.3%, respectively. These percentages seem to indicate that 
the 90°> E, model is much more accurate in this particular case, but this is not a com- 
plete statistical characterization. Figure 15 on page 40 shows the distribution of P, for 
all three sporadic E models. Between 14.4 and 18.2 MHz, the lower sporadic E models 
were able to match the actual data without predicting a large number of modes that had 
no Project NONCENTRIC equivalent. The 90% and 50% E, models showed a higher 
P, at lower frequencies, i.e., 6.9 to 9.9 MHz, than the data produced without sporadic 


E. The shapes of all three curves are approximately the same. 


39 





NI 
ae 
= 

ba a 
~ > 
WO 
Pid 
Lu 
2 
(=! 
Lu 
O- 
Le 
CO 
Ltt ~ 
DQ S Q SY ese) Sd fae) DQ DO fase] 
Dm CO Les WwW uD + foe) NSN —_ 


SGY093u GSHILVW 3O S9VLNSI4Sd 


Figure 15. The percentage of matching winter site O data relative to the total 


number of AMBCOM predictions (by frequency). 
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The average error also varied with the percentage of sporadic E. The largest 
amount of average error was exhibited by the 50% E, model, i.e. -9.6 dB. The 90% and 
0% £, data average error was -7.6 and -7.0 dB, respectively. Figure 16 on page 42 shows 
t'.at a large precentage of the error is distributed between -20 and + 20 dB, but the 50% 
sporadic E data shows a higher percentage of error outside of this range. Figure 17 on 
page 43 shows average error for all three models as it is distributed by frequency. The 
least amount of error is found in the frequency range between 9.9 and 20.9 MHz. This 
is not a clear indicator of the performance of AMBCO™M since the accuracy of the an- 
tenna patterns used to produce the data is unknown. 

2. Site C 

Data generated by AMBCOM produced error patterns similar to site O. The 
percentage of matched records (Pyo7) was 91.7% (90% E,), 87.3% (50% E,) and 70.3% 
(0% £,). The distribution of P, is very different from the pattern of the site O data (see 
Figure 18 on page 44). P, at higher frequencies did not greatly exceed those at lower 
frequencies and none of the percentages were larger than 55%. Some of these differ- 
ences may be caused by different receiving antennas at the two sites. 

The distribution of error (Figure 19 on page 45) exhibits that same skewed 
shape as site O data but the 50% E, curve does not have a second peak. The average 
error was -8.7 dB for 90% E,, -12.6 dB for 50% E, and -10.6 dB for 0% E,. The standard 
deviation of error for 90%, 50% and 0% E, models is 26.7 dB, 28.0 dB and 25.9 dB re- 
spectively. Figure 20 on page 46 shows the average error distributed by frequency. The 
average error is between -20 and +20 dB for frequencies between 6.8 and 23.2 MHz, 
roughly similar to the site O distribution. This is interesting since AMBCOM is 
producing a smaller average error at the higher frequency inspite of a change in the re- 
ceive antenna. 

3. Site D 

The same trends continued for Site D data as were observed for Site O but the 
changes were not as dramatic. The overall percentage of matched records (P;,;) does 
not vary by more than a decade for all three modeling methods. The percentages are 
91.8%, 85.0%, and 81.8% for the 90%, 50% and 0% E, models respectively. The per- 
centage of matching AMBCOM records (see Figure 21 on page 48) showed a similar 
two peak pattern seen in site C data but peak values were in the 80% -90% range. The 
90” E, model (Figure 21 on page 48) demonstrated the lowest percentage of matches 
per frequency of the three models. A close examination of the tabular statistics in Ap- 
pendix C indicates that the percentage of matches for 13.9 to 20.3 MHz improves with 
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Figure 16. The winter sile O average error grouped in ten dB bins and plotted by 


percentage of error frequency. 
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Figure 17. 
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Figure 18. The percentage of matching winter site C data relative to the total 
number of AMBCOM predictions (by frequency). 
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Figure 19, The winter site C average eiror grouped in ten dB bins and plotted by 


percentage of error frequency, 
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Figure 20. 
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the 50% and 0% sporadic E models relative to the 90% E, version. It is particularly 
interesting to compare site C and D data, because they both used the same type of an- 
tenna but produce very different results. This may be attributed in part to the location 
of two sites and the possibility that the two antennas do not perform the same at their 
respective locations. 

The average error for all three models displaved some variation. The 90% E, 
model produced an average error of -7.2 dB. The 50% model exhibited an average error 
of -9.3 dB while the 0% model produced an average error of -11.1 dB. Figure 22 on 
page 49 shows the distribution of the average error for all three models. The curves are 
similar in shape and in location along the average error axis. Figure 23 on page S50 is 
the average error versus frequency for site D. Clearly, the site D distribution is similar 
to that of site C, and both sites demonstrate, as in the case of site O, that the smallest 


absolute value for average error is found at higher frequencies. 


D. SUMMER DATA 
1. Site O 

The summer campaign data produced results that varied slightly with the 
amount of sporadic E included in the AMBCOM model. The percentage of matched 
records (Pr9;) was, respectively, 95.0%, 84.8% and 79.1% for 90%, 50% and 0% E,. 
Figure 24 on page 5] is a plot of the percentage of matching AMBCOM (P,) data for 
each of the sporadic E models. AMBCOM predicted a larger percentage of the meas- 
ured data at high frequencies. The 90%, 50% and 0% E, results are similar below 13.9 
MHz, but the 90% model exhibited lower P, from 14.4 to 23.2 MHz. 

The average error of summer Site O data varied less than 3.5 dB between the 
three E, models. The 90% E, model produced an average error of -8.3 dB, but the 50% 
and 0% models exhibited an average error of -11.05 and -11.87 dB, respectively. 
Figure 25 on page 53 shows the error distributions for all sporadic E models for the 
summer campaign. The distribution is skewed in the direction of negative average error. 
The standard deviations for these distributions are 18.2 dB (90% E, ), 19.3 dB (50% E,) 
and 23.0 dB (0% E£,). The distribution of average error by frequency (Figure 26 on page 
54) is similar to the winter site O data. The lower frequency data exhibited larger ab- 
solute values of average error, but lower absolute error was the trend at higher fre- 
quencies, 1.e., 13.9 to 20.9 MHz. There was very little variation in average error with 
Es 
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Figure 21. The percentage of winter site D matching data referenced to the total 


number of AMBCOM predictions (by frequency). 
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Figure 22, The winter site D average error grouped in ten dB bins and plotted by 


percentage of error frequency. 
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Figure 24. The percentage of matching summer site O data reference to the total 


number of AMBCOMI predictions (by frequency). 
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Figure 25. Summer site O average error grouped in ten dB bins and plotted by 


percentage of error frequency. 














(9P) YONYd JNVYSAY 
Q QZ - Qb- Q9- Q8- 





24 ON 
24 70S 


CSN ZN ZS ZS LLNS LS LS LSS) 
[NNN NN 
Aa LET EES LET CET EF AD 


01 - 





AJNANOD 48S 


(ZHW) 


, listed by frequency. 


The average error, for summer site O 


Figure 26. 
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2. Site C 

The summer site C data produced a high percentage of matched data (P;9,) for 
all three E, models. The respective values for 90%, 50% and 0% E, are 95.8%, 90.8% 
and 81.8%. The distribution of P, was much different from that of the winter site C. 
Figure 27 on page 55 shows that P, was smaller at higher frequencies. This trend is the 
same for all three of the sporadic E models. For example, at 10.2 MHz all three of the 
models produced a high percentage of matching AMBCOM records. Peaks and valleys 
in this figure roughly agree with a similar distribution for summer site D. The common 
antenna model may be a major contributing factor. 

Site C average error was obtained by subtracting 15 dB from the AMBCOM 
SNR to account for onsite noise at the receiving station. The average error is -6.2 dB, 
-8.9 dB and -13.3 dB for 90%, 50% and 0% E,, respectively. Figure 28 on page 56 is 
the error distribution for site C. The distribution is skewed along the negative error axis. 
The 0% distribution is offset from the 90% and 50% curves. The standard deviations 
for these error data are 15.9 dB, 16.4 dB and 21.5 dB for 90%, 50% and 0% E,. 

3. Site D 

Summer site D statistics were similar to those for summer site C. The percent- 
age of matched records were, respectively, 89.1%, 80.4% and 76.0% for the 90%, 50% 
and 0% E, models. The distribution of P, is plotted in Figure 30 on page 58. This dis- 
tribution exhibit a peak and valley pattern similar to that of summer site C. Values for 
P, for site D are, generally, much higher than for site C. It is reasonable that the peaks 
and valleys are in part attributable to the behavior of the site antenna at different fre- 
quencies, i.e. the antenna patterns used for the AMBCOM modeling of these sites may 
not be completely correct. 

The average error for site D exhibited nearly the same pattern as for site C. The 
average error is -8.0 dB, -11.4 dB, and -17.0 dB for 90%, 50% and 0% E,, respectively. 
Figure 31 on page 59 shows the distribution of average error is centered near -20 dB for 
the 90% and 50% models. The 0% E, error distribution curve was shifted in the nega- 
uve direction along the average error axis with a peak value near -30 dB. The standard 
deviation of the error is 13.7 dB, 12.4 dB and 17.6 dB for the 90%, 50% and 0% models. 


Figure 32 on page 60 shows the distribution of average error by frequency. 
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Figure 27. The percentage of summer site C matching data reference to the total 
number of AMBCOM predictions (by frequency). 
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Figure 28. The summer site C average error grouped in ten dB bins and plotted by 


percentage of error frequency. 
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The average error, for summer site C, listed by frequency. 
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Figure 29. 
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Figure 30. The percentage of summer site D matching data reference to the total 


number of AMNIBCOM predictions (by frequency). 


§8 





(dB) 


AVERAGE ERROR 





uy YQ uD DY ud 
ioe) les) NS —N ~_ = = 


(fUdII9d) AQNSNDSYS YOUYS 


Figure 31. The summer site D average error grouped in ten dB bins and. plotted by 


percentage of error frequency. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 
1. The Project NONCENTRIC Data 
Project NONCENTRIC data were not designed for the validation of 
computer-based propagation prediction models. For example, data did not contain 
necessary information such as 
e measured or computed antenna patterns, 
® measured received field strengths at the antenna, 
e measured signal and noise levels at the receiver, 
© ground constands at receiver sites, 
e measured receiver site noise levels and 


@ periodic ionospheric data. 


For example, the antenna gain tables used by AMBCOM were modeled using estimated 
values of ground permutivity and conductivity for each receiver site. It is likely that these 
estimated parameters resulted in errors in the computation of AMBCOM SNRs. 
AMBCOM 's validity as a high-latitude propagation prediction model cannot be fully 
established by Project NONCENTRIC data since the impact of these errors on 
AMBCOM'’s accuracy cannot be evaluated. 

Project NONCENTRIC files were useful as a standard data base for comparing 
computer-based models. LONCAP, PROPHET and AMBCOM were executed using the 
same antenna gain tables, sunspot numbers, K, indices and frequencies. The data 
produced by these models were then compared to the same Project NONCENTRIC data 
using standardized analysis procedures. The results of these studies were comparable 
since errors introduced by estimated input parameters were the same for each model. 

2. AMBCOM 

The results from this thesis fully evaluate the usefullness of AMBCOM for 
high-latitude propagation modeling, but AMBCOM does perform well when compared 
to LONCAP and PROPHET. As may be observed in Appendix D, the normalized me- 
dian error for AMBCOM, for the winter campaign, ranged from -.2 dB to 5.8 dB. The 
winter campaign normalized error for IONCAP [Ref. 13: p. 24] and PROPHET [Ref. 
14: p. 39] were 4.6 dB and .77 dB, respectively. AMBCOM produced winter campaign 
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error distributions having standard deviations, depending upon E, model, ranging from 
15.9 dB to almost 20 dB. IONCAP’s standard deviation for the winter campaign error 
distribution was 18.5 dB [Ref. 13: p. 24]. PROPHET produced a standard deviation of 
i4.7 dB for a similar distribution [Ref. 14: p. 24]. Similar results were obtained for the 
site O summer campaign. 

A.MBCOM’s batch input mode and operational flexibility make it ideal for au- 
tomated data analysis and communication link modeling with unique antenna config- 
urations. AMBCOM allows the user to 

* create large input streams representing several campaign days, 

@ save data and report files for further processing, 

¢ add unique antenna patterns to AMBCOM‘s antenna library, 

© include user written programs within the AMBCOM batch input stream and 

® review data produced by program modules (e.g., review the NATGEN data passed 

to RAYTRA). 

IONCAP and PROPHET do not have all of these capabilities. IONCAP does not allow 
the user to easily add new antenna patterns to its antenna library. Tsolekas [Ref. 13] 
accounted for antenna effects by manually adjusting the IONCAP output. PROPHET 
does not provide a batch input mode, but PROPHET is an example of a interactive 
computer-based model with online editor features and both graphical and numerical 
output. Gikas [Ref. 14] found it necessary to produce the PROPHET model data one 
hour and one frequency at a time for a 25 day campaign. 

AMBCOM also has its limitations. AMBCOM is difficult to use because it 
provides the user with little online support. Some of AMBCOM’s shortcomings noted 
during this thesis are 

® input control parameters must be located in specified columns, 


e there are no data entry programs to assist the user in entering control parameters 
or antenna data, 


e there are no graphic output displays and 
¢ the programs run only on VAX VMS-based systems or a mainframe computer 
systems. 
Data produced by AMBCOM were displayed using a COMPAQ-386 and 
GRAPHTOOL because statistical trends are not easily visualized using numerical re- 


ports. 














3. Statistics 

The accumulation of propagation prediction model statistics, by frequency, are 
useful for highlighting patterns in model performance. The analvsis of IONCAP and 
PROPHET did not include statistics by frequency [Ref. 13 and 14]; however, the results 
from this thesis point to the importance of examining the performance of the model at 
each frequency. The general statistics and distributions of error provide only part of the 
picture of how well a model performs. For example, the 90% E, model for winter site 
O showed a Pro, of nearly 90° and a low absolute value of average error. An exam- 
ination of the average error by frequency reveals that the absolute value of low fre- 
quency average error was very large. The distribution of P, showed that a small 
percentage of AMBCOM predictions matched the measured data at low frequency. 


None of these trends may be observed with general statistics. 


B. RECOMMENDATIONS 
1. Comparison Data 
A new set of high-latitude data should be produced. This data should include 
e measured field strengths at the antenna and receiver, 
¢ measured noise levels throughout the receive site, 
¢ measured or, at least, carefully modeled antenna patterns and 
@ periodic ionospheric data from the WWV broadcast and other solar-terrestrial 
sources. 
This will provide the model user with a standard set of transmission data and the back- 
ground information needed to create input for his computer-based model. 
2. AMBCOM 
AMBCOM should be updated. The model should be redesigned with such fea- 


tures as 
® a menu-driven input editor, 
¢ achoice of operation modes, 1.e., interactive or batch, 
¢ the capability to maintain a library of transmitter;receiver sites and 


¢ graphic output displavs. 


One proposal is to use PROPHET’s user-friendly editor and graphic displays as a shell 
for the AMBCOM software. The user would have the interactive features of PROPHET 
but would have access to the powerful AMBCOM propagation prediction models. 
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AMBCOM should be downsized to run on PC-type microcomputers. The ma- 
jority of the military user community has access to Zenith 248 type microcomputers. 
Placing AMBCOM on a microcomputer will make it available to a larger segment of this 
user population. In addition, the microcomputer’s graphics capability would provide 
AMBCOM with a means of changing from numerical reports to graphical represent- 
ations of the data. The trends noted in this thesis were not dramatically noticeable until 
the data was graphed with PC-based software. AMBCOM provides no graphical dis- 
plays. 

3. Statistics 

All computer-based model examinations should use the same analysis method- 
ology. Statistics should include detailed information by frequency to include the average 
error and the percentage of matched records P, This will provide some insight regarding 


the behavior of the model at various frequencies. 
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APPENDIX B. STATISTIC.:.L ANAYLSIS PROGRAMS 


MODDAT 


CRA He Tee dese ve Fede Hee AI IH Hee Hee HET E HEME HE HH Hee FE EM HEN IE KE TET FETE FETE IER PETE TE HE Fe FEE FEM TE HE IE HEHE HEHE CTE 


c* 
c* 
c* 
c* 
c* 
c* 
Cre 


m W fo 


500 


B. 


cir 


c* 
c* 
C* 
Cre 
cr 


PROGRAM: MODDAT DATE: DEC 1990 
PROGRAMMER: D. J. WILSON 

MODDAT READS THE SUMMARY REPORT PRODUCED BY COMEFF AND STRIPS OUT THE 
THE TIME, FREQUENCY, AND SNR FOR LATER PROCESSING. THE DAY 

AND THE MONTH FOR WHICH THIS DATA WAS GENERATED IS 

ALSO RECORDED ON EACH OUTPUT RECORD. 


Hrervetete tere reve ve vedese se seve dese se Te ae Fete eT Te EMH FIC TE FE TC IC HE TE TN TIC TE TTT ICICI ICT Fe PTE I NK Fe RK 
REAL YFREQ,SNRIN ; SET UP REAL VARIABLES 
INTEGER MONTH, DAY, YHR ;SET UP INTEGER VARIABLES 
READ( 58,2) MONTH, DAY ; READ IN THE MONTH AND DAY 


FORMAT(12,1X,12) 

READ(5,10,ERR=300,END=500) YHR,YFREQ,SNRIN ;READ COMEFF LINE 

FORMAT(6X,12,12X,F4.1,49X,E11.4) ; IF ERROR GO TO 300 

IF (YFREQ. LT. 3. OR. YFREQ.GT.24) GO TO 3. ; FREQ BETWEEN 3 / 24 MHz 
; NO - THEN GO TO 3 


IF (SNRIN.EQ.0) GO TO 3 ; YES - THEN IS SNR EQUAL TO 0 
» YES - THEN GO TO 3 
WRITE(4,20) YHR,YFREQ,SNRIN,MONTH,DAY ; NO - WRITE RECORD FOR 


; LATER PROCESSING 
FORMAT(1X,12,2X,F4.1,2X,F7.2,2X,12,2X,12) 
GO TO 3 ;GO GET ANOTHER RECORD 
GO TO 3. ;IN THE EVENT A FORMAT ERROR IS DETECTED DURING A READ 
; THE PROGRAM TRANSFERS CONTROL TO STATEMENT 300 WHICH 
; IN CAUSES THE PROGRAM TO GO BACK AND READ ANOTHER 
;RECORD. THE ERROR RECORD IS EFFECTIVELY IGNORED. BY 
;DOING THIS THE PROGRAM ONLY USES THOSE INPUT RECORDS 
; WHICH MEET THE INPUT CRITERIA FOR A LINE OF INFORMATION 
; FROM THE BODY OF THE COMEFF SUMMARY REPORT AND IGNORES 
; THE REPORT HEADER AND TRAILERS. 


END 
WILSTAT 
eA M A AAAI H INI TTR RIANA IIIT IE ITT IR TR NTI IN IIIT TE TT TTR TR TART IRIN 
PROGRAM: WILSTAT DATE: DEC 1990 


PROGRAMMER: D. J. WILSON 

THIS PROGRAM COMPARES THE AMBCOM DATA WITH THE PROJECT NONCENTRIC 
DATA. IF THE DATA MATCHES THEN THE SNR FOR BOTH RECORDS, ERROR, 

SPREAD INDEX, FREQUENCY, TIME, MONTH AND HOUR ARE WRITTEN TO 

FILE FOR LATER PROCESSING. THE FREQUENCY AND SNR FOR UNMATCHED AMBCOM 
DATA ARE WRITTEN TO A FILE FOR FURTHER PROCESS BY THE PROGRAM WILMAT. 
THE UNMATCHED NONCENTRIC RECORDS ARE COUNTED AND THE TOTAL IS 
MAINTAINED IN A TABLE BY FREQUENCY. ADDITIONALLY THE AVERAGE SNR BY 


FREQUENCY AND HOUR IS ACCUMULATED. 
MAA AIA LL RAIL ERIE RL EVR IARI IIA IARI RI IVI AAAI PIA IIE INP RI 


neice! DATA SETUP sicidvineveiveredeiniueskacvesesesese dear iraede ade tesede severe tena RR TER TE 
REAL*8 SNRTAB(16,24,3) ,ERRTAB( 16,5) ,RECTOT( 16) ; SET UP DOUBLE 
REAL*8 ACTEMP,MODTEMP,TOAVERR,TOTREC,PRCNT,TOTMOD ; PRECISION 
; VARIABLES. 
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REAL*4 MFREQ,MSNR ; SET UP SINGLE PRECISION 
; VARIALBLES. 
REAL*4 FREQ,SNR,SPI 
INTEGER MHR,MMON,MDAY,DOM,MON,XHR,HOUR ; IDENTIFY INTEGER VARIALBES 
ACTEHP=0. ; INITIALIZE 
Crretedeiekicdeyede READ IN THE COMPARI SON DATA Sevededetetedeseve deve tek seve vee RR RI TC RI 
READ(2,10,END=1400) FREQ,SNR,SPI,DOM,MON,XHR ; NONCENTRIC DATA 
10 FORMAT(1X,F4. 1,1X,F7. 2,1X,F7.2,1X,12,2X,11,2X,12) 
20 READ(3,30,END=1500) MHR,MFREQ,MSNR,MMON,MDAY ; AMBCOM DATA 


30 FORMAT(1X,12,2X,F4.1,2X,F7.2,2X,12,2X,12) 
Cre aeaedere dere aedese seve de ves ae HITTER THI INN HAITI IE NAH ICT IER RITE IIT IIR IH IIR INHERIT IH 


c MSNR=MSNR - 15.0 ; USED TO ADD 15 dB OF NOISE TO 

3; SITES C AND D DATA. 

MODTEMP=0. ; INITIALIZE TEMP SPACE 

L=1 3; INITIAILIZE INDICES 

I=1 

J=1 

40 IF(MFREQ. EQ. SNRTAB(I,J,L)) THEN ; IS THE AMBCOM FREQ IN THE TABLE? 
GO TO 100 ; YES - GO PROCESS 
ELSE NO - FIND AN EMPTY SPOT 


IF(SNRTAB(I,J,L).EQ. 0) THEN 
SNRTAB(1,J,L)=MFREQ 


IS THIS AN EMPTY LINE? 
YES - SAVE FREQ 


GO TO 100 ; GO PROCESS 
ELSE 5; NO - 

I=I+1 ; INCREMENT BY 1 

GO TO 40 ; GO LOOK AT NEXT LINE OF TABLE 
ENDIF 


ENDIF 
C eee ADD SNR TO ACCUM SNR BY FREQ sAtgedninnidkinedcidininiicniinininnivicibiciiicn 
100 J=MHR+1 
SNRTAB(I,J,2)=MSNR + SNRTABCI,J,2) 
SNRTAB(I,J,3)=SNRTAB(1,J,3)+1 
cr MATCH THE RECORDS  wriecdeteievesededictete reer HRA IKI AIT H IIT TRI TIT 
105 ACTEMP=(MON*1E5)+(DOM* 1E2) + XHR 
MODTEMP= (MMON*1E5)+(MDAY*1E2)+MHR 
110 IF(ACTEMP-MODTEMP) 200,150,300 ;DO THE MONTHS, DAYS AND HOURS 


150) =I=1 ; MATCH? 
IF(FREQ-MFREQ) 200,155,300 ; YES - DO THE FREQ MATCH? 
155  ERR=MSNR-SNR ; YES - CALCULATE ERROR AND PRINT 


WRITE( 4,160) MFREQ,MSNR,SNR,ERR,SPI,MON,MDAY ,MHR 
160 FORMAT(1X,F4.1,1X,F7.2,1X,F7.2,1X,F7.2,1X,F7.2,1X,12,1X,12,1X,12) 
Cxrietrereve INCREMENT THE ERROR TABLE AT THE CORRECT FREQ %tetevedededededederededsdrdeid 
170 IFCMFREQ. EQ. ERRTAB(I,1)) THEN ;DOES THE AMBCOM FREQ = TABLE FREQ? 
GO TO 180 > YES - GO PROCESS 
ELSE ;NO - 
IF(ERRTAB(I,1).EQ.0) THEN ;1S THIS AN EMPTY SLOT IN TABLE? 
ERRTAB(I,1)=MFREQ ;YES - SAVE FREQ AND GO PROCESS 
ELSE 
I=I+1] ;NO - INCREMENT AND GO TRY AGAIN 
GO TO 170 
ENDIF 
ENDIF 
180 ERRTAB(I,2)=ERRTAB(I,2)+ERR 5; ADD ERROR FOR AVERAGE ERROR 
; CALCULATION LATER 
ERRTAB( 1 ,3)=ERRTAB(I,3)+1 ; ADD ONE TO MATCH RECORD COUNT 
ERRTAB(1,4)=ERRTAB(1,4)+ MSNR ; ADD SNR FOR AVERAGE SNR CALCULATION 
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READ(2,10,END=1400) FREQ,SNR,SPI,DOM,MON,XHR ;GET MORE ACTUAL DATA 


GO TO 20 ;GO GET MORE AMBCOM DATA 
C *¥%% NO MATCH - GET ANOTHER ACTUAL DATA RECORD *ieteitddeiedtictiei tai 
200 I=1 ; LIST MISS FOR ACTUAL RECORD IN TABLE 
210 IFCFREQ. EQ. ERRTAB(I,1)) THEN ; DOES ACTUAL FREQ EQ TABLE? 
GO TO 250 3; YES - GO PROCESS 
ELSE 3;NO - 
IF(CERRTAB(1,1).EQ.0) THEN ; IS THIS SLOT EMPTY? 
ERRTAB(1I,1)=FREQ 3; YES - SAVE ACTUAL FREQ IN TABLE 
GO TO 250 ;GO PROCESS 
ELSE 
I=I+1 ; INCREMENT BY ONE GO GET MORE 
GO TO 210 ; DATA 
ENDIF 
ENDIF 
250 ERRTAB(I,5)=ERRTAB(I,5)+1 ;ADD ONE TO ACTUAL MISSES 


WRITE(9,10) FREQ,SNR,SPI,DOM,MON,XHR ;FOR THAT FREQUENCY 
READ(2,10,END=1400) FREQ,SNR,SPI,DOM,MON,XHR ;GET ANOTHER ACTUAL 
ACTEMP=0 ;RECORD AND GO AGAIN 
GO TO 105 
Cc Seeks NO MATCH - GET MORE MORE MODEL DATA Jeverevedevesvede te detest see ted RIK RR CI 
300 WRITE(7,1450) MFREQ,MSNR ; SAVE AMBCOM DATA FOR WILMAT 
360 GO TO 20 ;GET ANOTHER AMBCOM RECORD 
C 
Cre OUT OF ACTUAL DATA PEAD ALL REMAINING MODEL RECORDS TO NO MATCH TABLE 
1400 WRITE(7,1450) MFREQ,MSNR 
1450 FORMAT( 1X,F4. 1,2X,F7. 2) 
1460 READ(3,30,END=2000) MHR,MFREQ,MSNR,MON,MDAY 
C MSNR=MSNR-15. 0 
GO TO 1400 


C 

C*** OUT OF MODEL DATA READ ALL REMAINING ACTUAL RECORDS TO NO MATCH TABLE 
1500 I=1 
1510 IF (FREQ. EQ. ERRTAB(I,1)) THEN ;I1S THIS ACTUAL FREQ THE CURRENT 


GO TO 1550 ; TABLE FREQ - YES THEN GO PROCESS 
ELSE 
IF(ERRTAB(I,1).EQ.0) THEN ;NO - IS THIS AN EMPTY SPOT? ' 
ERRTAB(I,1)=FREQ ;YES - SAVE THE ACTUAL FREQ 
ELSE 
I=I+1 ;NO - INCREMENT BY ONE AND GO 
GO TO 1510 ; LOOK AGAIN. 
ENDIF 
ENDIF : 
1550 ERRTAB(1I,5)=ERRTAB(I,5)+1 ; INCREMENT ACTUAL MISS COUNT FOR 


WRITE(9,10) FREQ,SNR2,SPI,DOM,MON,XHR ; THIS FREQ THEN WRITE THE 
READ(2,10,END=2000) FREQ,SNR,SPI .DOM,MON,XHR ; ACTUAL RECORD AND 


GO TO 1500 ;READ A NEW ACTUAL RECORD 
C 
C 
C*x*%* THE END ROUTINE - SPIT OUT ALL THE ACCUM DATA FROM THE TABLES 
C 
C 


2000 DO 2100 I=1,16 s 
IF(CERRTAB(1,1).EQ.0) THEN . Ve 
CONTINUE 
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ELSE 
IF (ERRTAB(I,3).GT.0) THEN 
AVEERR=( ERRTAB( I, 2)/ERRTAB(I,3)) 
AVESNR1=(ERRTAB(1,4)/ERRTAB(I,3)) 
TOAVERR= (AVEERR * ERRTAB(I,3))+TOAVERR 
TOTMOD = ERRTAB(1,3)+TOTMOD 
TOTREC= TOTREC + ERRTAB(1,5) | 
WRITE(5,2010) ERRTAB(I,1),ERRTAB(I,3),AVEERR,AVESNR1, | 
C ERRTAB(I,5) 
FORMAT( 1X,F4. 1,2X,F7. 0,2X,F7.2,2X,F10. 2,2X,F7. 0) 
ELSE 
AVERR=0. 0 
AVESNR1=0. 0 
TOTREC = TOTREC + ERRTAB(I,5) 
WRITE(5,2010) ERRTAB(I,1),ERRTAB(I,3),AVEERR,AVESNR1, 
C ERRTAB(I,5) 
ENDIF 
ENDIF 
DO 2170 J =1,24 
IF (SNRTAB(I,J,3).GT. 0) THEN 
SNRTAB(1,J,2)= (SNRTAB(I,J,2)/SNRTAB(1,J,3)) 
RECTOT(1)= RECTOT(I) + SNRTAB(I,J,3) 
ELSE 
SNRTAB(I,J,2)= -999. 
ENDIF 
2170 CONTINUE 
2100 CONTINUE 
2200 DO 2500 I=1,16 
IF (SNRTAB(T,1,1).GT.0) THEN 


2010 





WRITE(8,2040) SNRTAB(I,1,1),(SNRTAB(I,J,2), J=1,12) 
2040 FORMAT( '1' ,F4.1,12(1X,F4. 0)) 
WRITE(8,2050) SNRTAB(I,1,1),(SNRTAB(I,J,3),J=1,12) 
2050 FORMAT('2' ,F4. 1,12(1X,F4. 0)) 
WRITE(8, 2042) SNRTAB(I,1,1),(SNRTAB(I,J,2), J=13,24) 
2042 FORMAT( '3' ,F4. 1,12(1X,F4. 0)) 
WRITE(8,2052) SNRTAB(I,1,1),(SNRTAB(I,J,3) ,J=13,24) 
2052 FORMAT('4' ,F4. 1,12(1X,F4. 0)) 
WRITE(8,2045) SNRTAB(I,1,1) ,RECTOT(1) 
2045 FORMAT('S',F4.1,1X,'TOTAL NUMBER OF RECORDS' ,2X,F7. 2) 
ELSE 
CONTINUE 
ENDIF 
2500 CONTINUE 


TOAVERR= ( TOAVERR/TOTMOD ) 
PRCNT= (TOTMOD/( TOTMOD+TOTREC ) )*100 
WRITE(6,2600) PRCNT, TOAVERR 


2600 FORMAT(1X,F5.2,1X,F7. 2} 
END 
C. WILMAT 


CRM ek eke HEH HE IC HHH HEH HITE HE HEHE HE FE EIEN HEHEHE KE IEE FEE FE TE PEK M FEK FETE HE FE HE ENE HE FE FE HEHE FETE IE TE HEHEHE HEHEHE 


c* PROGRAM: WILMAT DATE: DEC 1990 

c* PROGRAMMER: D. J. WILSON 

c* THIS PROGRAM EXAMINES THE UNMATCHED AMBCOM PREDICTIONS AND DETERMINES 
c*® IF THEY ARE SIGNAL QUALITY TRANSMISSIONS. IF THE AMBCOMB PREDICTION 
c* PASSES THIS TEST, THEN THE COUNTER FOR THF TOTAL NUMBER OF AMBCOM 
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c* PREDICTIONS FOR THAT FREQUENCY IS INCREASED BY ONE. ONCE ALL THE 

c* AMBCOM PREDICTIONS ARE PROCESSED A REPORT CONTAINING, BY FREQUENCY, 

c* AVERAGE SNR, AVERAGE ERROR, NUMBER OF MATCHED RECORDS, NUMBER OF 

c* UNMATCHED ACTUAL RECORDS, NUMBER OF UNMATCHED AMBCOM RECORDS AND THE 
C* PERCENTAGE OF MATCHED AMBCOM RECORDS REFERENCED TO THE TOTAL NUMBER 


c* OF AMBCOM RECORDS FOR A GIVEN FREQUENCY. 
Cee tere seve te ae se ve dete de te ve Ye Fede se He Ie Fe He eM He ME TET HEE HEHE EHC TE Te ENE ETE HE VE WE VEC FE FE NEVE HE FETE NE FE Fe W TE HE TEE HEF NE EINE HE He HE. 


REAL*8 SNRTAB( 16,6) ; SET UP DOUBLE PRECISION TABLE 
REAL*4 MFREQ,NOSNR ,NOMAT ; RESERVE SPACE FOR REAL VARIABLES 
I=1 ; INITIALIZE INDICES 

J=1 


Cieineiniewiekt = BUILD UP TABLE OF AVERAGE FREQUENCY DATA tttHnnobindicid 
10  READ(3,50,END=100) FREQ,NOMAT,AVEERR,AVESNR1,ACTNOMAT ; READ 
; AVERAGE ERROR, AVERAGE SNR, 
NUMBER OF MATCHES, NUMBER OF 
ACTUAL MISSES. 
50  FORMAT(1X,F4. 1,2X,F7.0,2X,F7. 2,2X,F10. 2,2X,F7. 0) 
60  IF(FREQ.EQ.SNRTAB(I,1)) THEN ; IS THIS FREQ IN THE TABLE? 


GO TO 10 ; YES - GO PROCESS 
ELSE ; NO - FIND AN EMPTY SPACE 
IF(SNRTAB(1,1).EQ.0) THEN ; IS THIS SPACE EMPTY? 
SNRTAB(I,1)=FREQ ; YES - MOVE FREQ TO FIRST SPOT OF 
SNRTAB(I,2)=AVESNR1 ; THIS LINE OF THE TABLE AND THEN 
SNRTAB(1I,3)=AVEERR ; MOVE THE AVERAGE SNR, AVERAGE ERROR, 


SNRTAB( 1, 4)=NOMAT 
SNRTAB( I ,5)=ACTNOMAT 


NUMBER OF MATCHES PER FREQ, AND THE 
NUMBER OF UNMATCHE NONCENTRIC RECS 


GO TO 10 ; GO PROCESS 

ELSE ; NO - THIS SPACE IS NOT EMPTY 
T=I+1 ; INCREMENT INDEX BY 1 
GO TO 60 ; GO LOOK AGAIN 

ENDIF 


ENDIF 
Cx rH USE TABLE OF AVERAGE DATA TO SIFT UNMATCHED AMBCOM DATA ‘tii 
100 READ(4,150,END=380) MFREQ,NOSNR ; READ AN UNMATCHED AMBCOM RECORD 
150 FORMAT(1X,F4. 1,2X,F7. 2) 

I=] ; INITIALIZE THE INDICES 

J=1 
200  IF(SNRTAB(I,1).EQ.MFREQ) THEN DOES THE UNMATCHED AMBCOM FREQ 
EQUAL THE FREQ IN THIS LINE 
OF THE AVERAGE DATA TABLE? 


GO TO 300 ; YES - GO PROCESS 
ELSE ; NO 
IF(I.EQ. 16) THEN ; HAVE WE EXHAUSTED THE TABLE? 
GO TO 100 ; YES - GO GET ANOTHER RECORD 
ELSE ; NO - INCREMENT THE INDEX AND 
I=I+1 ; SEARCH NEXT LINE OF THE TABLE. 
GO TO 200 
ENDIF 
ENDIF 
300  IF(SNRTAB(I,2).GT.NOSNR) THEN ; IS AVERAGE SNR GREATER THAN 
; UNMATCHED AMBCOM RECORD SNR? 
GO TN 100 ; YES - THROWAWAY, GT A NEW REC. 
ELSE ; NO - GO PROCESS 
CONTINUE 
ENDIF 


350 SNRTAB(1,0}= SNRTAB(I,6)+1 ; ADD ONE TO THE COUNT OF UNMATCHED 











; AMBCOM PREDICTIONS WHICH HAVE NO 
; CORRESPONDING NONCENTRIC REC. 


GO TO 100 ; GET ANCTHER UNMATCHED AMBCOM REC. 
C xe OUTPUT THE TOTAL MISSES sitieiitintieddniiedereddciererkdrdnisededededesereaedesere re vea sere ae aege 
380 §©6©pO 400 I=1,16 ; WRITE THE TABLE WHICH CONTAINS FOR EACH 


; FREQUENCY THE AVERAGE SNR, AVERAGE ERROR, 
; NUMBER OF MATCHED RECORDS, NUMBER OF 
NONCENTRIC RECORDS WITHOUT MATCHES, AND 
NUMBER UNMATCHED AMBCOM RECORDS. 
IF (SNRTAB(1I,1).GT.0) THEN 


WRITE(5,2030) SNRTAB(I,1),SNRTAB(I,2),SNRTAB(I,3), 


C SNRTAB( 1,4) ,SNRTAB(1,5),SNRTAB(1,6) 

2030 FORMAT(1X,F4. 1,2X,F7. 2,2X,F7.2,2X,F7. 0,2X,F7. 0, 
C 2X,F10. 2) 
ELSE 

CONTINUE 
ENDIF 
400 CONTINUE 

END 
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APPENDIX C. TABLES OF SITE STATISTICS 


Table 7. WINTER SITE O - 90% ES 

[iitiy [roam [wareneb| wisses [wisses | 

zeae fe 80 oto a 

z 
2 

Oa 


PERCENTAGE MATCHED 88.93% AVERAGE ERROR -7.6dB 
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Table 8. WINTER SITE O - 50% ES 

[iii [ab [aby | MATCHED] Misses —[wisses |_| 
Ee 
poses 
ELE 
pes Paw [ as [60 [re [soo 
psa fies [eee [401600 


PERCENTAGE MATCHED 80.55% AVERAGE ERROR -9.61 dB 
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Table 9. WINTER SITE O - 0% ES 

FREQ NUMBER | ACTUAL | AMBCOM 
(MHz) (dB) (dB) MATCHED] MISSES MISSES Pi 
ress pa 09 |e [6 
pss eto 


PERCENTAGE MATCHED 68.32% AVERAGE ERROR -7.04 dB 




















Table 10. WINTER SITE C - 90% ES 
[atte ram [ray | MavcneD | wisses [asses [_ 
pests [80 [00 [00 
EE 
a 
pope fe [ e000 [oa 
peepee 0 


PERCENTAGE MATCHED 91.68% AVERAGE ERROR -8.75 dB 
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Table 11. WINTER SITE C - 50% ES 
[sie aby [ar waren ses — snes | 
pz psss_ [sf ef ne fs | 
2 A 


PERCENTAGE MATCHED 35.89% AVERAGE ERROR -13.87 dB 













ted 
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Table 12. WINTER SITE C - 0% ES 


pres. Taxe_Tenk [sche Taereat[asncow [7 
Peat [an fron waren sees wisses [7 
IE 
SS ECE 
ee ee eee 
EE Ea 


PERCENTAGE MATCHED 70.27° AVERAGE ERROR. -10.59 dB 



















u 


oo 
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Table 13. WINTER SITE D - 90% ES 
peak [ay [amy [warcep | wsses—[arsses | 
SE 


PERCENTAGE MATCHED 91.81% AVERAGE ERROR -7.20 dB 






















wn 
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Table 14. WINTER SITE D - 50% ES 
[aiiie, [am [amy | warcne) wisses —[wasses [| 
Sa 
pees a0 
a 


PERCENTAGE MATCHED 84.96%0 AVERAGE ERROR -9.26 dB 
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Table 15. WINTER SITE D - 0% ES 

[aria [ram [aay | Marcurp| wisses [asses | __ 
pes fs fan 80 [0a 
pes ass 80 [0a 
pos Pare e000 oo 
fea [aa [es [000 eo To 


PERCENTAGE MATCHED 81.81% AVERAGE ERROR _ -11.10 dB 
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Table 16. SUMMER SITE O - 90% ES 
(MHz) (dB) MATCHED| MISSES | MISSES |_| 
a 
cE a 
AC 
RO 
ras [rf sf 500+ r800 a 
ras [a6 [aoe [ere [a0 [aio [os] 
pose 
pos fsa [a3 [0260 Jeno Pa 


PERCENTAGE MATCHED 94.97% AVERAGE ERROR. -8.33 dB 
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Table 17. SUMMER SITE O - 50% ES 
FREQ [SNR | ERR NUMBER | ACTUAL | AMBCOM 
(MHz) (dB) (dB) MATCHED] MISSES MISSES a 
fez [a [ws [aso | _anioo [oa 


PERCENTAGE MATCHED 84.80% AVERAGE ERROR -11.05 dB 















to 
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Table 18. SUMMER SITE O - 0% ES 


Presa ese [ann _[sewiben [acveat Tavncon 
[ait [rab [amy [aToHE wisses [wisses | 
a 
[espa ase [ea | 
pes esate [oso Pa 
aap se [es [ a0 [0 [800 
pea paras [| [00 [| 


PERCENTAGE MATCHED 79.11% AVERAGE ERROR -11.87 dB 






























85 


Table 19. SUMMER SITE C - 90% ES : 

[oatiz, [rab [tay | WATCHED] wisses | wisses | 
ps2 fae [ors [80 [00 [noo 
pas 3s [ase 00 [180000 
rsa [wos [res [00 ts an 
res [aes [00000 
res [wor [38 [ao [0 | of 
P93 [ast Pio [90 2003006 
faa [ 261 [a6 | 06 [20 | itn [0a 
pas [3 [26 [80 [100] 9000 [ana 
fsa [ee [eof a0 [eo [3008 
feos [so aas [4050 [9.00 fat 


PERCENTAGE MATCHED 95.80% AVERAGE ERROR __ -6.23 dB 
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Table 20. SUMMER SITE C - 50% ES 

[eatiz, [ab [ay | MATCHED[ wisses [asses | 
raz fs pser_ | se | eo | ooo | | 
rasa fs n0 |200 28 
res [safer f sto [30 | 80 sia 
pes [92a | ae [20 | 1500 fn 
pes [ata | 0 [20 | 060s 
ex [s_[vos_| 2n0 [80] 00 [ans 
x9 [re _[-p0 | 1900] 80 | 119.0 ons 
faa [383 [ aco [veo | oto | 163, 
ras [sia_[22 [eo [0 | 7000 [oa 
az 8 p73] 0 | eo | 00 
os [ees] mo | oo | 800 | 289 


PERCENTAGE MATCHED 90.82% AVERAGE ERROR __ -8.88 dB 























87 


Table 21. SUMMER SITE C - 0% ES 

[oatiey [rab [tay [WATCHED] wisses | wisses—[__ 
paz fare [50 [00 to0 
pasa [seo [008 
pes [aa [ass [8000 
pes fs [aes of [500 a 
ress [aor [990 [ i000 
pos [a1 [aes [iso | ao [3002 
faa [96 [ans [960 [30 [9500 fora 
sa pas [830 [0 | 75.00 aaa 
[a3 [46a [vas 290 [100 [e008 
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Table 22. SUMMER SITE D - 90% ES 
[aie [aay [eb | MATCHED] Misses wisses | 
pass 6 [090 [00 of 
Psa [aes Prins [ eso [00 [3600780 
res [ua [oo [so [0 | 00] 
res [as 33 [mo [ a0 | 9400 | 
SE 
poss [na [3590 [00 [90.00 [00 

ne sa_|-37_[ 30] _10__| 20600 | 0] 
faa [ss [e000 [80 
ras [ee [16 |e 0 | 19600 
pans [asf 100 [60 | 01 [98019 


PERCENTAGE MATCHED 89.14% AVERAGE ERROR __ -8.02 dB 
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Table 23. SUMMER SITE D - 50% ES 
[Gita [rem [aay [MATCHED] misses [Misses [| 
pasa [nei 90800703 
pez [ror [aes [i280 [00 [350078 
pes [safe 80 [00 | e00e 
res fare [-e3_[ 80 [00 | _tot00 Ysa 
pss far [reo 80 [0 [roan 
[oa [ans [aar [3560 [30 [000 
faa [ore [ana 30_ [aro [00 [ar 
a 
oO 
pos [saa [sof ato 


PERCENTAGE MATCHED 80.45% AVERAGE ERROR 



























-11.44 dB 
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Table 24. SUMMER SITE D- 0% ES 

[ite [rem [ray [waren wisses | wisses | 
res [0 [asso [0 | 00 03 
pes pat [oss piso | 0 fos 
a 
pass [et [m0 [oreo 
peas 86 | wo | 0 [om [00 
[aaa [as [0 ao 07) 
Ea 


PERCENTAGE MATCHED 75.98% AVERAGE ERROR __ -16.96 dB 
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APPENDIX D. COMPARIABLE STATISTICS 


The tables and figures listed in this Appendix were compiled from a subset of 
AMBCOM data. Earlier computer-based model validations [Ref. 14 and 13] modeled 
six of the 13 Project NONCENTRIC frequencies, e.g., 6.8, 6.9, 9.9, 13.9, 17.5 and 20.3 
MHz. In addition, onlv site O data were examined. The data presented in this Appendix 
are for those frequencies and site O only. The figures are directly compareable to the 


figures produced in the earlier studies. 


Table 25. WINTER SITE O STATISTICS (NORMALIZED TO ZERO MEAN 
ERROR). 











% Sporadic E 0% 
[Medan Boras Si sd 


Table 26. SUMMER SITE O STATISTICS (NORMALIZED TO ZERO MEAN 
ERROR). 


[Medan Evortapy SiO id 
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Figure 33. The 1989 winter campaign average error for all three sporadic E models. 
(10 dB bins) 
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Figure 34. The 1989 winter campaign cumulative error of absolute value of the ay- 


erage error. 
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Figure 35. The 1988 summer campaign average error for all three sporadic E mod- 
els. (10 dB bins) 
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Figure 36. The 1989 summer campaign cumulative error of absolute value of the 


average error. 
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